Sep 29 12:17:18 devstack cinder-volume[75398]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 29 12:17:18 devstack cinder-volume[75398]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 29 12:17:18 devstack cinder-volume[75398]: we strongly recommend against using it for new projects.
Sep 29 12:17:18 devstack cinder-volume[75398]: If you are already using Eventlet, we recommend migrating to a different
Sep 29 12:17:18 devstack cinder-volume[75398]: framework.  For more detail see
Sep 29 12:17:18 devstack cinder-volume[75398]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 29 12:17:18 devstack cinder-volume[75398]:   import eventlet  # noqa
Sep 29 12:17:21 devstack cinder-volume[75398]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 12:17:21 devstack cinder-volume[75398]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 12:17:21 devstack cinder-volume[75398]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 12:17:22 devstack cinder-volume[75398]: INFO dbcounter [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Registered counter for database cinder
Sep 29 12:17:22 devstack cinder-volume[75398]: DEBUG oslo_db.sqlalchemy.engines [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG dbcounter [-] [75398] Writer thread running {{(pid=75398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 12:17:23 devstack cinder-volume[75398]: INFO cinder.rpc [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 29 12:17:23 devstack cinder-volume[75398]: INFO cinder.rpc [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_db.sqlalchemy.engines [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:17:23 devstack cinder-volume[75398]: INFO cinder.volume.manager [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Determined volume DB was empty at startup.
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG cinder.volume.manager [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75398) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 29 12:17:23 devstack cinder-volume[75398]: INFO cinder.volume.manager [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 29 12:17:23 devstack cinder-volume[75398]: WARNING stevedore.named [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 29 12:17:23 devstack cinder-volume[75398]: WARNING castellan.key_manager [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 12:17:23 devstack cinder-volume[75398]: WARNING cinder.keymgr.conf_key_mgr [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG cinder.volume.drivers.lvm [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75398) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_concurrency.processutils [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_concurrency.processutils [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] CMD "cinder-rtstool verify" returned: 0 in 0.428s {{(pid=75398) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_db.sqlalchemy.engines [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:17:23 devstack cinder-volume[75398]: INFO cinder.rpc [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 29 12:17:23 devstack cinder-volume[75398]: INFO cinder.rpc [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 29 12:17:23 devstack cinder-volume[75398]: WARNING stevedore.named [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 29 12:17:23 devstack cinder-volume[75398]: WARNING castellan.key_manager [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 12:17:23 devstack cinder-volume[75398]: INFO cinder.volume.manager [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_db.sqlalchemy.engines [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:17:23 devstack cinder-volume[75398]: INFO oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Starting 1 workers
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Started child 75557 {{(pid=75398) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Full set of CONF: {{(pid=75398) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] ******************************************************************************** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Configuration options gathered from: {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] ================================================================================ {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] allow_availability_zone_fallback = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] allow_compression_on_image_upload = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] allowed_direct_url_schemes     = [] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] api_rate_limit                 = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] auth_strategy                  = keystone {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] az_cache_duration              = 3600 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_availability_zone      = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_host                   = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_name                   = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_stats_polling_interval = 60 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backup_api_class               = cinder.backup.api.API {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backup_name_template           = backup-%s {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backup_use_same_host           = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backup_use_temp_snapshot       = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] chap_password                  = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] chap_username                  =  {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cinder_internal_tenant_project_id = 2a8f25f1a76341f7aaf1a6475529e5ae {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cinder_internal_tenant_user_id = c17de904ad8446b9a19c81b828f9fef9 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cloned_volume_same_az          = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cluster                        = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] compression_format             = gzip {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] config_dir                     = [] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] config_source                  = [] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] control_exchange               = openstack {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] debug                          = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] default_availability_zone      = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] default_group_type             = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] default_volume_type            = lvmdriver-1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] disk_geometry                  = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] driver_client_cert             = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] driver_client_cert_key         = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] driver_data_namespace          = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] driver_ssl_cert_path           = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] driver_ssl_cert_verify         = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] driver_use_ssl                 = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] enable_force_upload            = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] enable_new_services            = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] enable_unsupported_driver      = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] enforce_multipath_for_image_xfer = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] filter_function                = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance_api_insecure            = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance_api_servers             = ['http://192.168.122.30/image'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance_api_ssl_compression     = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance_ca_certificates_file    = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance_certfile                = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance_keyfile                 = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance_num_retries             = 3 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance_request_timeout         = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] goodness_function              = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] graceful_shutdown_timeout      = 5 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] group_api_class                = cinder.group.api.API {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] host                           = devstack {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] image_compress_on_upload       = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] image_conversion_address_space_limit = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] image_conversion_cpu_limit     = 60 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] image_conversion_disable       = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75557]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0)
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] image_introspection_address_space_limit = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] image_introspection_cpu_limit  = 60 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] image_upload_use_cinder_backend = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] image_upload_use_internal_tenant = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] image_volume_cache_enabled     = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] image_volume_cache_max_count   = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] image_volume_cache_max_size_gb = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] init_host_max_objects_retrieval = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] iscsi_target_flags             =  {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] iscsi_write_cache              = on {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] iser_helper                    = tgtadm {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] iser_ip_address                = 192.168.122.30 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] iser_port                      = 3260 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] log_color                      = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] log_config_append              = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] log_dir                        = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] log_file                       = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] log_options                    = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] log_rotate_interval            = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] log_rotate_interval_type       = days {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] log_rotation_type              = none {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] max_age                        = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] max_logfile_count              = 30 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] max_logfile_size_mb            = 200 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] max_over_subscription_ratio    = 20.0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] message_reap_interval          = 86400 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] message_ttl                    = 2592000 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] migration_create_volume_timeout_secs = 300 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] monkey_patch                   = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] monkey_patch_modules           = [] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] my_ip                          = 192.168.122.30 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] no_snapshot_gb_quota           = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] num_iser_scan_tries            = 3 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] num_shell_tries                = 3 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] num_volume_device_scan_tries   = 3 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] nvmeof_conn_info_version       = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] nvmet_ns_id                    = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] nvmet_port_id                  = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] osapi_max_limit                = 1000 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] osapi_volume_ext_list          = [] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] osapi_volume_listen_port       = 8776 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] osapi_volume_use_ssl           = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] osapi_volume_workers           = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] per_volume_size_limit          = -1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] periodic_fuzzy_delay           = 60 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] periodic_interval              = 60 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] public_endpoint                = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] publish_errors                 = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] quota_backup_gigabytes         = 1000 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] quota_backups                  = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] quota_gigabytes                = 1000 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] quota_groups                   = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] quota_snapshots                = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] quota_volumes                  = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] rate_limit_burst               = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] rate_limit_except_level        = CRITICAL {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] rate_limit_interval            = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] reinit_driver_count            = 3 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] replication_device             = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] report_discard_supported       = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] report_interval                = 120 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] reservation_clean_interval     = 86400 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] reservation_expire             = 86400 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] reserved_image_namespaces      = [] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] reserved_percentage            = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] rpc_response_timeout           = 120 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] run_external_periodic_tasks    = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] scst_target_driver             = iscsi {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:23 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] scst_target_iqn_name           = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_down_time              = 720 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] shell_completion               = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] snapshot_name_template         = snapshot-%s {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] snapshot_same_host             = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] split_loggers                  = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] state_path                     = /opt/stack/data/cinder {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] storage_availability_zone      = nova {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] storage_protocol               = iSCSI {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] syslog_log_facility            = LOG_USER {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] target_helper                  = lioadm {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] target_ip_address              = 192.168.122.30 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] target_port                    = 3260 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] target_protocol                = iscsi {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] target_secondary_ip_addresses  = [] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] trace_flags                    = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] transport_url                  = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] until_refresh                  = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] use_chap_auth                  = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] use_default_quota_class        = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] use_journal                    = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] use_json                       = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] use_multipath_for_image_xfer   = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] use_stderr                     = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] use_syslog                     = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] verify_glance_signatures       = enabled {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volume_api_class               = cinder.volume.api.API {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volume_backend_name            = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volume_clear                   = zero {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volume_clear_ionice            = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volume_clear_size              = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volume_copy_bps_limit          = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volume_dd_blocksize            = 1M {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volume_name_template           = volume-%s {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volume_service_inithost_offload = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volume_usage_audit_period      = month {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] zoning_mode                    = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_concurrency.disable_process_locking = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75557]: INFO cinder.volume.manager [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.auth_section = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.auth_type   = password {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.auth_version = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.cache       = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.certfile    = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.include_service_catalog = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.insecure    = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.interface   = public {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.keyfile     = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_password = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcache_username = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.region_name = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.service_type = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.30/identity {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.backend                  = dogpile.cache.null {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.backend_argument         = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.backend_expiration_time  = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.config_prefix            = cache.oslo {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.debug_cache_backend      = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.enable_retry_client      = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.enable_socket_keepalive  = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.enabled                  = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.expiration_time          = 600 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.hashclient_retry_attempts = 2 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.memcache_dead_retry      = 300 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.memcache_sasl_enabled    = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.password                 = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.proxies                  = [] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.redis_db                 = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.redis_server             = localhost:6379 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.retry_attempts           = 2 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.retry_delay              = 0.0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.socket_keepalive_count   = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.socket_keepalive_idle    = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.socket_keepalive_interval = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.socket_timeout           = 1.0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.tls_allowed_ciphers      = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.tls_cafile               = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.tls_certfile             = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.tls_enabled              = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.tls_keyfile              = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cache.username                 = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] coordination.backend_url       = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.asyncio_connection    = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.asyncio_slave_connection = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.backend               = sqlalchemy {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.connection            = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.connection_debug      = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.connection_parameters =  {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.connection_recycle_time = 3600 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.connection_trace      = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.db_inc_retry_interval = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.db_max_retries        = 20 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.db_max_retry_interval = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.db_retry_interval     = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.max_overflow          = 50 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.max_pool_size         = 5 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.max_retries           = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.mysql_wsrep_sync_wait = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.pool_timeout          = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.retry_interval        = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.slave_connection      = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.sqlite_synchronous    = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.synchronous_reader    = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] database.use_db_reconnect      = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_tracing.insecure = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler.connection_string     = messaging:// {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler.enabled               = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler.es_doc_type           = notification {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler.es_scroll_size        = 10000 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler.es_scroll_time        = 2m {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler.filter_error_trace    = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler.hmac_keys             = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler.sentinel_service_name = mymaster {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler.socket_timeout        = 0.1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler.trace_requests        = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler.trace_sqlalchemy      = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler_jaeger.process_tags   = {} {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler_jaeger.service_name_prefix = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] profiler_otlp.service_name_prefix = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_policy.enforce_new_defaults = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_policy.policy_default_rule = default {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] privsep_osbrick.group          = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] privsep_osbrick.helper_command = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] privsep_osbrick.user           = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cinder_sys_admin.group         = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cinder_sys_admin.helper_command = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] cinder_sys_admin.user          = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_user.auth_section      = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_user.auth_type         = password {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_user.cafile            = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_user.certfile          = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_user.collect_timing    = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_user.insecure          = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_user.keyfile           = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_user.send_service_user_token = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_user.split_loggers     = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_user.timeout           = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_user.tls_ciphers       = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] service_user.tls_min_version   = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance.auth_section            = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance.auth_type               = password {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance.certfile                = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance.collect_timing          = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance.insecure                = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance.keyfile                 = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance.region_name             = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance.split_loggers           = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance.timeout                 = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance.tls_ciphers             = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] glance.tls_min_version         = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.backend_availability_zone = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.chap_password = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.chap_username =  {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack sudo[75562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.disk_geometry = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.driver_client_cert = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.driver_client_cert_key = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.driver_data_namespace = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack sudo[75562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.driver_use_ssl = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.extra_capabilities = {} {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.filter_function = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.goodness_function = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.iscsi_target_flags =  {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.iscsi_write_cache = on {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.iser_ip_address = 192.168.122.30 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.iser_port     = 3260 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.lvm_share_target = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.lvm_type      = auto {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.num_shell_tries = 3 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.replication_device = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.report_discard_supported = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.reserved_percentage = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.target_helper = tgtadm {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.target_ip_address = 192.168.122.30 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.target_port   = 3260 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.target_protocol = iscsi {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.trace_flags   = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.unique_fqdn_network = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.use_chap_auth = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.volume_backend_name = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.volume_clear  = zero {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.volume_clear_ionice = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.volume_clear_size = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_reports.file_event_handler = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_reports.log_dir           = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.backend_host       = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.chap_password      = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.chap_username      = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.disk_geometry      = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.driver_client_cert = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.extra_capabilities = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.filter_function    = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.goodness_function  = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.iser_helper        = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.iser_port          = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.lvm_type           = auto {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.replication_device = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.report_discard_supported = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.reserved_percentage = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.scst_target_driver = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.storage_protocol   = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.target_ip_address  = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.target_port        = 3260 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.trace_flags        = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.volume_clear       = zero {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] lvmdriver-1.volumes_dir        = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_notifications.driver = [] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_notifications.retry = -1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] key_manager.fixed_key          = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.barbican_api_version  = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.barbican_endpoint     = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.barbican_endpoint_type = public {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.barbican_region_name  = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.cafile                = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.certfile              = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.collect_timing        = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.insecure              = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.keyfile               = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.number_of_retries     = 60 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.retry_delay           = 1 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.send_service_user_token = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.split_loggers         = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.timeout               = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.tls_ciphers           = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.tls_min_version       = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.verify_ssl            = True {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican.verify_ssl_path       = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican_service_user.auth_section = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican_service_user.auth_type = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican_service_user.cafile   = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican_service_user.certfile = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican_service_user.collect_timing = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican_service_user.insecure = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican_service_user.keyfile  = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican_service_user.split_loggers = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican_service_user.timeout  = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican_service_user.tls_ciphers = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] barbican_service_user.tls_min_version = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.approle_role_id          = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.approle_secret_id        = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.auth_method              = approle {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.auth_path                = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.kv_mountpoint            = secret {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.kv_path                  = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.kv_version               = 2 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.namespace                = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.root_token_id            = **** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.ssl_ca_crt_file          = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.timeout                  = 60.0 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.token_file               = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.token_role               = None {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.use_ssl                  = False {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:17:24 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] ******************************************************************************** {{(pid=75398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 29 12:17:24 devstack sudo[75562]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:24 devstack sudo[75655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:17:24 devstack sudo[75655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:24 devstack sudo[75655]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.347s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:17:24 devstack cinder-volume[75557]: INFO cinder.brick.local_dev.lvm [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:24 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:24 devstack sudo[75753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 12:17:24 devstack sudo[75753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:25 devstack sudo[75753]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:25 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:25 devstack cinder-volume[75557]: DEBUG cinder.brick.local_dev.lvm [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75557) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 29 12:17:25 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:25 devstack sudo[75850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:17:25 devstack sudo[75850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:25 devstack sudo[75850]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:25 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.534s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:25 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:25 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:25 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:25 devstack sudo[76051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:17:25 devstack sudo[76051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:26 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:26 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:26 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.064s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:26 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:25 devstack sudo[76051]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:26 devstack sudo[76171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 29 12:17:26 devstack sudo[76171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:26 devstack sudo[76171]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:26 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.263s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:26 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:26 devstack sudo[76174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 12:17:26 devstack sudo[76174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:26 devstack sudo[76174]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:26 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.343s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:26 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:26 devstack sudo[76257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 12:17:26 devstack sudo[76257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:26 devstack sudo[76257]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:26 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:26 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:26 devstack sudo[76260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:17:26 devstack sudo[76260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:27 devstack sudo[76260]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:27 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:27 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:27 devstack sudo[76312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:17:27 devstack sudo[76312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:27 devstack sudo[76312]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:27 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:27 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:27 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:27 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:27 devstack sudo[76359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:17:27 devstack sudo[76359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:27 devstack sudo[76359]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:27 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:27 devstack cinder-volume[75557]: INFO cinder.volume.drivers.lvm [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 29 12:17:27 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:27 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:27 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:27 devstack sudo[76363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:17:27 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:28 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:28 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:28 devstack cinder-volume[75557]: DEBUG cinder.volume.drivers.lvm [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Updating volume stats {{(pid=75557) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 12:17:28 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:28 devstack sudo[76366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 12:17:28 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:28 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:28 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:28 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:28 devstack sudo[76369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:17:28 devstack sudo[76369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:28 devstack sudo[76369]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:28 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.236s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:28 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:28 devstack sudo[76372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:17:28 devstack sudo[76372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:28 devstack sudo[76372]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:28 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:28 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:28 devstack sudo[76375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:17:28 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:29 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:29 devstack cinder-volume[75557]: INFO cinder.volume.driver [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Driver hasn't implemented _init_vendor_properties()
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG cinder.volume.driver [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75557) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG oslo_db.sqlalchemy.engines [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75557) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG dbcounter [-] [75557] Writer thread running {{(pid=75557) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG cinder.db.api [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Building query based on filter {{(pid=75557) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG cinder.image.image_utils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75557) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 29 12:17:29 devstack cinder-volume[75557]: INFO cinder.keymgr.migration [None req-9bc2153e-9dcf-40e5-91cc-89fbb89a8cc9 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG cinder.volume.drivers.lvm [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Updating volume stats {{(pid=75557) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:29 devstack sudo[76378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 12:17:29 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:29 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:29 devstack sudo[76382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:17:29 devstack sudo[76382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:29 devstack sudo[76382]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:29 devstack sudo[76386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:17:29 devstack sudo[76386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:29 devstack sudo[76386]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:29 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:29 devstack sudo[76390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:17:29 devstack sudo[76390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:30 devstack sudo[76390]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:30 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:30 devstack cinder-volume[75557]: DEBUG cinder.manager [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Notifying Schedulers of capabilities ... {{(pid=75557) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:17:30 devstack cinder-volume[75557]: INFO cinder.volume.manager [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Driver initialization completed successfully.
Sep 29 12:17:30 devstack cinder-volume[75557]: INFO cinder.manager [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Initiating service 2 cleanup
Sep 29 12:17:30 devstack cinder-volume[75557]: INFO cinder.manager [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Service 2 cleanup completed.
Sep 29 12:17:30 devstack cinder-volume[75557]: DEBUG cinder.service [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Creating RPC server for service cinder-volume {{(pid=75557) start /opt/stack/cinder/cinder/service.py:231}}
Sep 29 12:17:30 devstack cinder-volume[75557]: DEBUG cinder.service [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75557) start /opt/stack/cinder/cinder/service.py:237}}
Sep 29 12:17:30 devstack cinder-volume[75557]: INFO cinder.volume.manager [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 29 12:17:30 devstack cinder-volume[75557]: DEBUG cinder.volume.drivers.lvm [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Updating volume stats {{(pid=75557) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 12:17:30 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:30 devstack sudo[76393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 12:17:30 devstack sudo[76393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:30 devstack sudo[76393]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:30 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:30 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:30 devstack sudo[76399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:17:30 devstack sudo[76399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:30 devstack sudo[76399]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:30 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:30 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:30 devstack sudo[76404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:17:30 devstack sudo[76404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:31 devstack sudo[76404]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:17:31 devstack sudo[76407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:17:31 devstack sudo[76407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:17:31 devstack sudo[76407]: pam_unix(sudo:session): session closed for user root
Sep 29 12:17:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:17:31 devstack cinder-volume[75557]: INFO cinder.volume.manager [None req-09f7edf3-317c-43de-be36-c8d8f0d3c5c4 None None] Driver post RPC initialization completed successfully.
Sep 29 12:17:31 devstack cinder-volume[75557]: DEBUG oslo_service.periodic_task [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running periodic task VolumeManager._thread_info {{(pid=75557) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:17:31 devstack cinder-volume[75557]: DEBUG cinder.volume.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] thread count: 6 {{(pid=75557) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:17:31 devstack cinder-volume[75557]: DEBUG cinder.volume.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] thread info: [<_MainThread(MainThread, started 124146904998016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124146789845760)>, <Thread(Thread-3 (stat_writer), started daemon 124146788500928)>, <Thread(Rabbit-heartbeat, started daemon 124146788506368)>, <Thread(Thread-5 (_runner), started daemon 124146787307968)>, <Thread(Thread-7 (_runner), started daemon 124146787438976)>] {{(pid=75557) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:17:33 devstack cinder-volume[75398]: DEBUG dbcounter [-] [75398] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:17:40 devstack cinder-volume[75557]: DEBUG dbcounter [-] [75557] Writing DB stats cinder:SELECT=3 {{(pid=75557) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:17:41 devstack cinder-volume[75557]: DEBUG dbcounter [-] [75557] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75557) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:18:31 devstack cinder-volume[75557]: DEBUG oslo_service.periodic_task [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75557) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:18:31 devstack cinder-volume[75557]: DEBUG cinder.volume.drivers.lvm [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Updating volume stats {{(pid=75557) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 12:18:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:18:31 devstack sudo[78345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 12:18:31 devstack sudo[78345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:18:31 devstack sudo[78345]: pam_unix(sudo:session): session closed for user root
Sep 29 12:18:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:18:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:18:31 devstack sudo[78359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:18:31 devstack sudo[78359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:18:31 devstack sudo[78359]: pam_unix(sudo:session): session closed for user root
Sep 29 12:18:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:18:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:18:31 devstack sudo[78369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:18:31 devstack sudo[78369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:18:32 devstack sudo[78369]: pam_unix(sudo:session): session closed for user root
Sep 29 12:18:32 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:18:32 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:18:32 devstack sudo[78372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:18:32 devstack sudo[78372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:18:32 devstack sudo[78372]: pam_unix(sudo:session): session closed for user root
Sep 29 12:18:32 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:18:32 devstack cinder-volume[75557]: DEBUG cinder.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Notifying Schedulers of capabilities ... {{(pid=75557) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:18:32 devstack cinder-volume[75557]: DEBUG oslo_service.periodic_task [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running periodic task VolumeManager._thread_info {{(pid=75557) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:18:32 devstack cinder-volume[75557]: DEBUG cinder.volume.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] thread count: 6 {{(pid=75557) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:18:32 devstack cinder-volume[75557]: DEBUG cinder.volume.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] thread info: [<_MainThread(MainThread, started 124146904998016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124146789845760)>, <Thread(Thread-3 (stat_writer), started daemon 124146788500928)>, <Thread(Rabbit-heartbeat, started daemon 124146788506368)>, <Thread(Thread-5 (_runner), started daemon 124146787307968)>, <Thread(Thread-7 (_runner), started daemon 124146787438976)>] {{(pid=75557) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:19:31 devstack cinder-volume[75557]: DEBUG oslo_service.periodic_task [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75557) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:19:31 devstack cinder-volume[75557]: DEBUG cinder.volume.drivers.lvm [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Updating volume stats {{(pid=75557) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 12:19:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:19:31 devstack sudo[81713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 12:19:31 devstack sudo[81713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:19:31 devstack sudo[81713]: pam_unix(sudo:session): session closed for user root
Sep 29 12:19:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:19:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:19:31 devstack sudo[81717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:19:31 devstack sudo[81717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:19:31 devstack sudo[81717]: pam_unix(sudo:session): session closed for user root
Sep 29 12:19:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:19:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:19:31 devstack sudo[81724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:19:31 devstack sudo[81724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:19:32 devstack sudo[81724]: pam_unix(sudo:session): session closed for user root
Sep 29 12:19:32 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:19:32 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:19:32 devstack sudo[81732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:19:32 devstack sudo[81732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:19:32 devstack sudo[81732]: pam_unix(sudo:session): session closed for user root
Sep 29 12:19:32 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:19:32 devstack cinder-volume[75557]: DEBUG cinder.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Notifying Schedulers of capabilities ... {{(pid=75557) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:19:32 devstack cinder-volume[75557]: DEBUG oslo_service.periodic_task [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running periodic task VolumeManager._thread_info {{(pid=75557) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:19:32 devstack cinder-volume[75557]: DEBUG cinder.volume.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] thread count: 6 {{(pid=75557) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:19:32 devstack cinder-volume[75557]: DEBUG cinder.volume.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] thread info: [<_MainThread(MainThread, started 124146904998016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124146789845760)>, <Thread(Thread-3 (stat_writer), started daemon 124146788500928)>, <Thread(Rabbit-heartbeat, started daemon 124146788506368)>, <Thread(Thread-5 (_runner), started daemon 124146787307968)>, <Thread(Thread-7 (_runner), started daemon 124146787438976)>] {{(pid=75557) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:19:41 devstack cinder-volume[75557]: DEBUG dbcounter [-] [75557] Writing DB stats cinder:SELECT=1 {{(pid=75557) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:19:41 devstack cinder-volume[75557]: DEBUG dbcounter [-] [75557] Writing DB stats cinder:UPDATE=1 {{(pid=75557) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:20:31 devstack cinder-volume[75557]: DEBUG oslo_service.periodic_task [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75557) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:20:31 devstack cinder-volume[75557]: DEBUG cinder.volume.drivers.lvm [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Updating volume stats {{(pid=75557) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 12:20:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:20:31 devstack sudo[83754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 12:20:31 devstack sudo[83754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:20:31 devstack sudo[83754]: pam_unix(sudo:session): session closed for user root
Sep 29 12:20:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:20:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:20:31 devstack sudo[83779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:20:31 devstack sudo[83779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:20:31 devstack sudo[83779]: pam_unix(sudo:session): session closed for user root
Sep 29 12:20:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:20:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:20:31 devstack sudo[83782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:20:31 devstack sudo[83782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:20:32 devstack sudo[83782]: pam_unix(sudo:session): session closed for user root
Sep 29 12:20:32 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:20:32 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:20:32 devstack sudo[83788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:20:32 devstack sudo[83788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:20:32 devstack sudo[83788]: pam_unix(sudo:session): session closed for user root
Sep 29 12:20:32 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:20:32 devstack cinder-volume[75557]: DEBUG cinder.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Notifying Schedulers of capabilities ... {{(pid=75557) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:20:32 devstack cinder-volume[75557]: DEBUG oslo_service.periodic_task [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running periodic task VolumeManager._thread_info {{(pid=75557) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:20:32 devstack cinder-volume[75557]: DEBUG cinder.volume.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] thread count: 6 {{(pid=75557) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:20:32 devstack cinder-volume[75557]: DEBUG cinder.volume.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] thread info: [<_MainThread(MainThread, started 124146904998016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124146789845760)>, <Thread(Thread-3 (stat_writer), started daemon 124146788500928)>, <Thread(Rabbit-heartbeat, started daemon 124146788506368)>, <Thread(Thread-5 (_runner), started daemon 124146787307968)>, <Thread(Thread-7 (_runner), started daemon 124146787438976)>] {{(pid=75557) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:21:31 devstack cinder-volume[75557]: DEBUG oslo_service.periodic_task [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75557) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:21:31 devstack cinder-volume[75557]: DEBUG cinder.volume.drivers.lvm [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Updating volume stats {{(pid=75557) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 12:21:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:21:31 devstack sudo[85021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 12:21:31 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:21:31 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root
Sep 29 12:21:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:21:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:21:31 devstack sudo[85024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:21:31 devstack sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:21:31 devstack sudo[85024]: pam_unix(sudo:session): session closed for user root
Sep 29 12:21:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:21:31 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:21:31 devstack sudo[85028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 12:21:31 devstack sudo[85028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:21:32 devstack sudo[85028]: pam_unix(sudo:session): session closed for user root
Sep 29 12:21:32 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:21:32 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:21:32 devstack sudo[85031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 12:21:32 devstack sudo[85031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:21:32 devstack sudo[85031]: pam_unix(sudo:session): session closed for user root
Sep 29 12:21:32 devstack cinder-volume[75557]: DEBUG oslo_concurrency.processutils [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75557) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:21:32 devstack cinder-volume[75557]: DEBUG cinder.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Notifying Schedulers of capabilities ... {{(pid=75557) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:21:32 devstack cinder-volume[75557]: DEBUG oslo_service.periodic_task [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] Running periodic task VolumeManager._thread_info {{(pid=75557) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:21:32 devstack cinder-volume[75557]: DEBUG cinder.volume.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] thread count: 6 {{(pid=75557) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:21:32 devstack cinder-volume[75557]: DEBUG cinder.volume.manager [None req-0bc36085-a39f-4bda-ab90-745501b31123 None None] thread info: [<_MainThread(MainThread, started 124146904998016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124146789845760)>, <Thread(Thread-3 (stat_writer), started daemon 124146788500928)>, <Thread(Rabbit-heartbeat, started daemon 124146788506368)>, <Thread(Thread-5 (_runner), started daemon 124146787307968)>, <Thread(Thread-7 (_runner), started daemon 124146787438976)>] {{(pid=75557) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:21:41 devstack cinder-volume[75557]: DEBUG dbcounter [-] [75557] Writing DB stats cinder:SELECT=1 {{(pid=75557) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:21:41 devstack cinder-volume[75557]: DEBUG dbcounter [-] [75557] Writing DB stats cinder:UPDATE=1 {{(pid=75557) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:21:49 devstack cinder-volume[75398]: INFO oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Caught SIGTERM, stopping children
Sep 29 12:21:49 devstack cinder-volume[75398]: DEBUG oslo_concurrency.lockutils [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Acquiring lock "singleton_lock" {{(pid=75398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 12:21:49 devstack cinder-volume[75398]: DEBUG oslo_concurrency.lockutils [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Acquired lock "singleton_lock" {{(pid=75398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 12:21:49 devstack cinder-volume[75398]: DEBUG oslo_concurrency.lockutils [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Releasing lock "singleton_lock" {{(pid=75398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 12:21:49 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Stop services. {{(pid=75398) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 29 12:21:49 devstack cinder-volume[75398]: DEBUG oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Killing children. {{(pid=75398) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 29 12:21:49 devstack cinder-volume[75398]: INFO oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Waiting on 1 children to exit
Sep 29 12:21:50 devstack cinder-volume[75557]: DEBUG oslo_concurrency.lockutils [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Acquiring lock "singleton_lock" {{(pid=75557) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 12:21:50 devstack cinder-volume[75557]: DEBUG oslo_concurrency.lockutils [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Acquired lock "singleton_lock" {{(pid=75557) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 12:21:50 devstack cinder-volume[75557]: DEBUG oslo_concurrency.lockutils [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Releasing lock "singleton_lock" {{(pid=75557) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 12:21:50 devstack cinder-volume[75557]: WARNING amqp [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 29 12:21:50 devstack cinder-volume[75557]: WARNING amqp [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 29 12:21:50 devstack cinder-volume[75398]: INFO oslo_service.backend._eventlet.service [None req-642ad980-db3e-4e74-a237-8aa9fd9fdb34 None None] Child 75557 exited with status 0
Sep 29 12:21:50 devstack cinder-volume[85525]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 29 12:21:50 devstack cinder-volume[85525]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 29 12:21:50 devstack cinder-volume[85525]: we strongly recommend against using it for new projects.
Sep 29 12:21:50 devstack cinder-volume[85525]: If you are already using Eventlet, we recommend migrating to a different
Sep 29 12:21:50 devstack cinder-volume[85525]: framework.  For more detail see
Sep 29 12:21:50 devstack cinder-volume[85525]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 29 12:21:50 devstack cinder-volume[85525]:   import eventlet  # noqa
Sep 29 12:21:52 devstack cinder-volume[85525]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 12:21:52 devstack cinder-volume[85525]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 12:21:52 devstack cinder-volume[85525]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 12:21:53 devstack cinder-volume[85525]: INFO dbcounter [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Registered counter for database cinder
Sep 29 12:21:53 devstack cinder-volume[85525]: DEBUG oslo_db.sqlalchemy.engines [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85525) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:21:53 devstack cinder-volume[85525]: DEBUG dbcounter [-] [85525] Writer thread running {{(pid=85525) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 12:21:53 devstack cinder-volume[85525]: INFO cinder.rpc [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 29 12:21:54 devstack cinder-volume[85525]: INFO cinder.rpc [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_db.sqlalchemy.engines [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85525) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:21:54 devstack cinder-volume[85525]: INFO cinder.volume.manager [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Determined volume DB was empty at startup.
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG cinder.volume.manager [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85525) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 29 12:21:54 devstack cinder-volume[85525]: INFO cinder.volume.manager [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 29 12:21:54 devstack cinder-volume[85525]: WARNING stevedore.named [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 29 12:21:54 devstack cinder-volume[85525]: WARNING castellan.key_manager [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 12:21:54 devstack cinder-volume[85525]: WARNING cinder.keymgr.conf_key_mgr [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 12:21:54 devstack cinder-volume[85525]: INFO cinder.volume.manager [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_db.sqlalchemy.engines [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85525) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:21:54 devstack cinder-volume[85525]: INFO oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Starting 1 workers
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Started child 85742 {{(pid=85525) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Full set of CONF: {{(pid=85525) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] ******************************************************************************** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Configuration options gathered from: {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] ================================================================================ {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] allow_availability_zone_fallback = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] allow_compression_on_image_upload = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] allowed_direct_url_schemes     = [] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] api_rate_limit                 = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] auth_strategy                  = keystone {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85742]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0)
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_availability_zone      = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_host                   = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_name                   = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_stats_polling_interval = 60 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backup_api_class               = cinder.backup.api.API {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backup_name_template           = backup-%s {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backup_use_same_host           = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backup_use_temp_snapshot       = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] chap_password                  = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] chap_username                  =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cinder_internal_tenant_project_id = 2a8f25f1a76341f7aaf1a6475529e5ae {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cinder_internal_tenant_user_id = c17de904ad8446b9a19c81b828f9fef9 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cluster                        = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] compression_format             = gzip {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] config_dir                     = [] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] config_source                  = [] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] control_exchange               = openstack {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] debug                          = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] default_availability_zone      = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] default_group_type             = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] default_volume_type            = QuobyteHD {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] disk_geometry                  = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] driver_client_cert             = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] driver_client_cert_key         = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] driver_data_namespace          = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] driver_ssl_cert_path           = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] driver_ssl_cert_verify         = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] driver_use_ssl                 = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] enable_new_services            = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] enable_unsupported_driver      = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] enforce_multipath_for_image_xfer = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] filter_function                = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance_api_insecure            = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance_api_servers             = ['http://192.168.122.30/image'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance_api_ssl_compression     = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance_ca_certificates_file    = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance_certfile                = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance_keyfile                 = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance_num_retries             = 3 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance_request_timeout         = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] goodness_function              = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] graceful_shutdown_timeout      = 5 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] group_api_class                = cinder.group.api.API {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] host                           = devstack {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] image_compress_on_upload       = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] image_conversion_address_space_limit = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] image_conversion_cpu_limit     = 60 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] image_conversion_disable       = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] image_introspection_address_space_limit = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] image_introspection_cpu_limit  = 60 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] image_upload_use_cinder_backend = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] image_upload_use_internal_tenant = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] image_volume_cache_enabled     = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] image_volume_cache_max_count   = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] image_volume_cache_max_size_gb = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] init_host_max_objects_retrieval = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] iscsi_target_flags             =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] iscsi_write_cache              = on {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] iser_helper                    = tgtadm {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] iser_ip_address                = 192.168.122.30 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] iser_port                      = 3260 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] log_color                      = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] log_config_append              = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] log_dir                        = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] log_file                       = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] log_options                    = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] log_rotate_interval            = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] log_rotate_interval_type       = days {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] log_rotation_type              = none {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] max_age                        = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] max_logfile_count              = 30 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] max_logfile_size_mb            = 200 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] max_over_subscription_ratio    = 20.0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] message_reap_interval          = 86400 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85742]: INFO cinder.volume.manager [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] message_ttl                    = 2592000 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] migration_create_volume_timeout_secs = 300 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] monkey_patch                   = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] monkey_patch_modules           = [] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] my_ip                          = 192.168.122.30 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85742]: DEBUG cinder.volume.drivers.remotefs [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85742) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] no_snapshot_gb_quota           = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] num_iser_scan_tries            = 3 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] num_shell_tries                = 3 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] num_volume_device_scan_tries   = 3 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] nvmeof_conn_info_version       = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] nvmet_ns_id                    = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] nvmet_port_id                  = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] osapi_max_limit                = 1000 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] osapi_volume_ext_list          = [] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] osapi_volume_listen_port       = 8776 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] osapi_volume_use_ssl           = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] osapi_volume_workers           = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] per_volume_size_limit          = -1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] periodic_fuzzy_delay           = 60 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] periodic_interval              = 60 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] public_endpoint                = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] publish_errors                 = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] quota_backup_gigabytes         = 1000 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] quota_backups                  = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] quota_gigabytes                = 1000 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] quota_groups                   = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] quota_snapshots                = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] quota_volumes                  = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] rate_limit_burst               = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] rate_limit_except_level        = CRITICAL {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] rate_limit_interval            = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] reinit_driver_count            = 3 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] replication_device             = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] report_discard_supported       = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] report_interval                = 120 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] reservation_clean_interval     = 86400 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] reservation_expire             = 86400 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] reserved_image_namespaces      = [] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] reserved_percentage            = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] rpc_response_timeout           = 120 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] run_external_periodic_tasks    = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] scst_target_driver             = iscsi {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] scst_target_iqn_name           = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_down_time              = 720 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] shell_completion               = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] snapshot_name_template         = snapshot-%s {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] split_loggers                  = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] state_path                     = /opt/stack/data/cinder {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] storage_availability_zone      = nova {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] storage_protocol               = iSCSI {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] syslog_log_facility            = LOG_USER {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] target_helper                  = lioadm {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] target_ip_address              = 192.168.122.30 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] target_port                    = 3260 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] target_protocol                = iscsi {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] target_secondary_ip_addresses  = [] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] trace_flags                    = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] transport_url                  = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] until_refresh                  = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] use_chap_auth                  = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] use_default_quota_class        = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] use_journal                    = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] use_json                       = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] use_multipath_for_image_xfer   = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] use_stderr                     = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] use_syslog                     = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] verify_glance_signatures       = enabled {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volume_api_class               = cinder.volume.api.API {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volume_backend_name            = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volume_clear                   = zero {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volume_clear_ionice            = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volume_clear_size              = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volume_copy_bps_limit          = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volume_dd_blocksize            = 1M {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volume_name_template           = volume-%s {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volume_service_inithost_offload = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volume_usage_audit_period      = month {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] zoning_mode                    = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_concurrency.disable_process_locking = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.auth_section = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.auth_type   = password {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.auth_version = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.cache       = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.certfile    = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.include_service_catalog = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.insecure    = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.interface   = public {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.keyfile     = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_password = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcache_username = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.region_name = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.service_type = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.30/identity {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.backend                  = dogpile.cache.null {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.backend_argument         = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.backend_expiration_time  = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.config_prefix            = cache.oslo {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.debug_cache_backend      = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.enable_retry_client      = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.enable_socket_keepalive  = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.enabled                  = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.expiration_time          = 600 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.hashclient_retry_attempts = 2 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.memcache_dead_retry      = 300 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85742]: DEBUG cinder.volume.drivers.quobyte [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85742) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 29 12:21:54 devstack cinder-volume[85742]: WARNING cinder.volume.drivers.quobyte [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.memcache_sasl_enabled    = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85742]: WARNING cinder.volume.drivers.quobyte [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 29 12:21:54 devstack cinder-volume[85742]: DEBUG oslo_concurrency.processutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Running cmd (subprocess): mount.quobyte {{(pid=85742) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.password                 = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.proxies                  = [] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.redis_db                 = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.redis_server             = localhost:6379 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.retry_attempts           = 2 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.retry_delay              = 0.0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.socket_keepalive_count   = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.socket_keepalive_idle    = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.socket_keepalive_interval = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.socket_timeout           = 1.0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.tls_allowed_ciphers      = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.tls_cafile               = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.tls_certfile             = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.tls_enabled              = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.tls_keyfile              = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cache.username                 = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] coordination.backend_url       = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.asyncio_connection    = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.asyncio_slave_connection = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.backend               = sqlalchemy {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.connection            = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.connection_debug      = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.connection_parameters =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.connection_recycle_time = 3600 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.connection_trace      = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.db_inc_retry_interval = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.db_max_retries        = 20 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.db_max_retry_interval = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.db_retry_interval     = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.max_overflow          = 50 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.max_pool_size         = 5 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.max_retries           = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.mysql_wsrep_sync_wait = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.pool_timeout          = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.retry_interval        = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.slave_connection      = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.sqlite_synchronous    = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.synchronous_reader    = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] database.use_db_reconnect      = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_tracing.insecure = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler.connection_string     = messaging:// {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler.enabled               = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler.es_doc_type           = notification {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler.es_scroll_size        = 10000 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler.es_scroll_time        = 2m {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler.filter_error_trace    = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler.hmac_keys             = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler.sentinel_service_name = mymaster {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler.socket_timeout        = 0.1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler.trace_requests        = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler.trace_sqlalchemy      = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler_jaeger.process_tags   = {} {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler_jaeger.service_name_prefix = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] profiler_otlp.service_name_prefix = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_policy.enforce_new_defaults = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_policy.policy_default_rule = default {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] privsep_osbrick.group          = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] privsep_osbrick.helper_command = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] privsep_osbrick.user           = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cinder_sys_admin.group         = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cinder_sys_admin.helper_command = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] cinder_sys_admin.user          = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_user.auth_section      = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_user.auth_type         = password {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_user.cafile            = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_user.certfile          = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_user.collect_timing    = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_user.insecure          = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_user.keyfile           = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_user.send_service_user_token = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_user.split_loggers     = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_user.timeout           = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_user.tls_ciphers       = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] service_user.tls_min_version   = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance.auth_section            = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance.auth_type               = password {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance.certfile                = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance.collect_timing          = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance.insecure                = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance.keyfile                 = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance.region_name             = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance.split_loggers           = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance.timeout                 = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance.tls_ciphers             = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] glance.tls_min_version         = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.backend_availability_zone = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.chap_password = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.chap_username =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.disk_geometry = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.driver_client_cert = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.driver_client_cert_key = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.driver_data_namespace = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.driver_use_ssl = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.extra_capabilities = {} {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.filter_function = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.goodness_function = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.iscsi_target_flags =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.iscsi_write_cache = on {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.iser_ip_address = 192.168.122.30 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.iser_port     = 3260 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nas_host      =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nas_login     = admin {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nas_mount_options = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nas_password  = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nas_private_key =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nas_share_path =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.num_shell_tries = 3 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.quobyte_volume_url = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.replication_device = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.report_discard_supported = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.reserved_percentage = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.target_helper = tgtadm {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.target_ip_address = 192.168.122.30 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.target_port   = 3260 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.target_protocol = iscsi {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.trace_flags   = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.unique_fqdn_network = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.use_chap_auth = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.volume_backend_name = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.volume_clear  = zero {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.volume_clear_ionice = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.volume_clear_size = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_reports.file_event_handler = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_reports.log_dir           = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.backend_availability_zone = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.backend_host         = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.chap_password        = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.chap_username        = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.disk_geometry        = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.driver_client_cert   = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.driver_data_namespace = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.extra_capabilities   = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.filter_function      = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.goodness_function    = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.iser_helper          = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.iser_ip_address      = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.iser_port            = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nas_host             = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nas_login            = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nas_mount_options    = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nas_password         = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nas_private_key      = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nas_share_path       = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.num_shell_tries      = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.replication_device   = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.report_discard_supported = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.reserved_percentage  = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.scst_target_driver   = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.storage_protocol     = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.target_helper        = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.target_ip_address    = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.target_port          = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.target_prefix        = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.target_protocol      = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.trace_flags          = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.use_chap_auth        = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.volume_clear         = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.volume_clear_size    = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] QuobyteHD.volumes_dir          = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack quobyte-client[85747]: Reading configuration file: /etc/quobyte/client.cfg
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack quobyte-client[85747]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_notifications.driver = [] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_notifications.retry = -1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85742]: DEBUG oslo_concurrency.processutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] CMD "mount.quobyte" returned: 1 in 0.156s {{(pid=85742) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:21:54 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:21:54 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:21:54 devstack cinder-volume[85742]: DEBUG cinder.volume.drivers.quobyte [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=85742) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] key_manager.fixed_key          = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.barbican_api_version  = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.barbican_endpoint     = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.barbican_endpoint_type = public {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.barbican_region_name  = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.cafile                = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85742]: INFO cinder.volume.drivers.quobyte [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 ...
Sep 29 12:21:54 devstack cinder-volume[85742]: DEBUG oslo_concurrency.processutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef -c /etc/quobyte/client-cinder.cfg {{(pid=85742) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.certfile              = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.collect_timing        = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.insecure              = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.keyfile               = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.number_of_retries     = 60 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.retry_delay           = 1 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.send_service_user_token = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.split_loggers         = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.timeout               = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.tls_ciphers           = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.tls_min_version       = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.verify_ssl            = True {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican.verify_ssl_path       = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican_service_user.auth_section = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican_service_user.auth_type = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican_service_user.cafile   = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican_service_user.certfile = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican_service_user.collect_timing = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican_service_user.insecure = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican_service_user.keyfile  = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican_service_user.split_loggers = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican_service_user.timeout  = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican_service_user.tls_ciphers = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] barbican_service_user.tls_min_version = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.approle_role_id          = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.approle_secret_id        = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.auth_method              = approle {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.auth_path                = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.kv_mountpoint            = secret {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.kv_path                  = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.kv_version               = 2 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.namespace                = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.root_token_id            = **** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.ssl_ca_crt_file          = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.timeout                  = 60.0 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.token_file               = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.token_role               = None {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.use_ssl                  = False {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:21:54 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] ******************************************************************************** {{(pid=85525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 29 12:21:54 devstack sudo[85754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef -c /etc/quobyte/client-cinder.cfg
Sep 29 12:21:54 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:21:55 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.processutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.420s {{(pid=85742) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:21:55 devstack cinder-volume[85742]: INFO cinder.volume.drivers.quobyte [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 succeeded
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG cinder.volume.drivers.quobyte [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=85742) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.434s {{(pid=85742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.processutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=85742) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:21:55 devstack sudo[85856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:21:55 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:21:55 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.processutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.243s {{(pid=85742) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:21:55 devstack cinder-volume[85742]: INFO cinder.volume.driver [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Driver hasn't implemented _init_vendor_properties()
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG cinder.volume.driver [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0505638122559, 'free_capacity_gb': 1775.0505638122559, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85742) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_db.sqlalchemy.engines [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85742) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG dbcounter [-] [85742] Writer thread running {{(pid=85742) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG cinder.db.api [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Building query based on filter {{(pid=85742) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG cinder.image.image_utils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85742) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 29 12:21:55 devstack cinder-volume[85742]: INFO cinder.keymgr.migration [None req-b4843cd6-7694-4f68-968f-0721d68d1bb9 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG cinder.volume.drivers.quobyte [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=85742) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG cinder.volume.drivers.quobyte [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=85742) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.processutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=85742) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:21:55 devstack sudo[85859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:21:55 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:21:55 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.processutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.234s {{(pid=85742) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG cinder.manager [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Notifying Schedulers of capabilities ... {{(pid=85742) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:21:55 devstack cinder-volume[85742]: INFO cinder.volume.manager [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Driver initialization completed successfully.
Sep 29 12:21:55 devstack cinder-volume[85742]: INFO cinder.manager [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Initiating service 3 cleanup
Sep 29 12:21:55 devstack cinder-volume[85742]: INFO cinder.manager [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Service 3 cleanup completed.
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG cinder.service [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Creating RPC server for service cinder-volume {{(pid=85742) start /opt/stack/cinder/cinder/service.py:231}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG cinder.service [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85742) start /opt/stack/cinder/cinder/service.py:237}}
Sep 29 12:21:55 devstack cinder-volume[85742]: INFO cinder.volume.manager [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG cinder.volume.drivers.quobyte [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=85742) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG cinder.volume.drivers.quobyte [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=85742) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:21:55 devstack cinder-volume[85742]: DEBUG oslo_concurrency.processutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=85742) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:21:55 devstack sudo[85862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:21:55 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:21:56 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root
Sep 29 12:21:56 devstack cinder-volume[85742]: DEBUG oslo_concurrency.processutils [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.253s {{(pid=85742) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:21:56 devstack cinder-volume[85742]: INFO cinder.volume.manager [None req-0f028fe9-9a3d-4ea6-8cff-f9d463d8fa94 None None] Driver post RPC initialization completed successfully.
Sep 29 12:22:00 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-9707909f-2b8e-4e13-95ec-6ce92375b600 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:22:00 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-9707909f-2b8e-4e13-95ec-6ce92375b600 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:22:00 devstack cinder-volume[85742]: DEBUG cinder.volume.drivers.quobyte [None req-9707909f-2b8e-4e13-95ec-6ce92375b600 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=85742) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:22:00 devstack cinder-volume[85742]: DEBUG cinder.volume.drivers.quobyte [None req-9707909f-2b8e-4e13-95ec-6ce92375b600 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=85742) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:22:00 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-9707909f-2b8e-4e13-95ec-6ce92375b600 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:22:00 devstack cinder-volume[85742]: DEBUG oslo_concurrency.processutils [None req-9707909f-2b8e-4e13-95ec-6ce92375b600 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=85742) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:22:00 devstack sudo[86008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:22:00 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:22:00 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root
Sep 29 12:22:00 devstack cinder-volume[85742]: DEBUG oslo_concurrency.processutils [None req-9707909f-2b8e-4e13-95ec-6ce92375b600 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.251s {{(pid=85742) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:22:00 devstack cinder-volume[85742]: DEBUG cinder.manager [None req-9707909f-2b8e-4e13-95ec-6ce92375b600 None None] Notifying Schedulers of capabilities ... {{(pid=85742) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:22:01 devstack cinder-volume[85525]: INFO oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Caught SIGTERM, stopping children
Sep 29 12:22:01 devstack cinder-volume[85525]: DEBUG oslo_concurrency.lockutils [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Acquiring lock "singleton_lock" {{(pid=85525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 12:22:01 devstack cinder-volume[85525]: DEBUG oslo_concurrency.lockutils [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Acquired lock "singleton_lock" {{(pid=85525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 12:22:01 devstack cinder-volume[85525]: DEBUG oslo_concurrency.lockutils [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Releasing lock "singleton_lock" {{(pid=85525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 12:22:01 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Stop services. {{(pid=85525) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 29 12:22:01 devstack cinder-volume[85525]: DEBUG oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Killing children. {{(pid=85525) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 29 12:22:01 devstack cinder-volume[85525]: INFO oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Waiting on 1 children to exit
Sep 29 12:22:01 devstack cinder-volume[85742]: DEBUG oslo_service.periodic_task [None req-ec6bd462-d8bd-48cc-aa4f-ea568c33fde9 None None] Running periodic task VolumeManager._thread_info {{(pid=85742) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:22:01 devstack cinder-volume[85742]: DEBUG cinder.volume.manager [None req-ec6bd462-d8bd-48cc-aa4f-ea568c33fde9 None None] thread count: 6 {{(pid=85742) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:22:01 devstack cinder-volume[85742]: DEBUG cinder.volume.manager [None req-ec6bd462-d8bd-48cc-aa4f-ea568c33fde9 None None] thread info: [<_MainThread(MainThread, started 134271271829632)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134271156696192)>, <Thread(Thread-3 (stat_writer), started daemon 134271158400896)>, <Thread(Rabbit-heartbeat, started daemon 134271155708608)>, <Thread(Thread-7 (_runner), started daemon 134271155788992)>, <Thread(Thread-4 (_process_in_background), started daemon 134271167428608)>] {{(pid=85742) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:22:04 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Acquiring lock "singleton_lock" {{(pid=85742) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 12:22:04 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Acquired lock "singleton_lock" {{(pid=85742) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 12:22:04 devstack cinder-volume[85742]: DEBUG oslo_concurrency.lockutils [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Releasing lock "singleton_lock" {{(pid=85742) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 12:22:04 devstack cinder-volume[85742]: WARNING amqp [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 29 12:22:04 devstack cinder-volume[85742]: WARNING amqp [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 29 12:22:04 devstack cinder-volume[85525]: INFO oslo_service.backend._eventlet.service [None req-769e6187-35c4-4c4b-8744-7731eac27737 None None] Child 85742 exited with status 0
Sep 29 12:22:04 devstack cinder-volume[86063]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 29 12:22:04 devstack cinder-volume[86063]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 29 12:22:04 devstack cinder-volume[86063]: we strongly recommend against using it for new projects.
Sep 29 12:22:04 devstack cinder-volume[86063]: If you are already using Eventlet, we recommend migrating to a different
Sep 29 12:22:04 devstack cinder-volume[86063]: framework.  For more detail see
Sep 29 12:22:04 devstack cinder-volume[86063]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 29 12:22:04 devstack cinder-volume[86063]:   import eventlet  # noqa
Sep 29 12:22:08 devstack cinder-volume[86063]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86063) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 12:22:08 devstack cinder-volume[86063]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86063) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 12:22:08 devstack cinder-volume[86063]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86063) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 12:22:08 devstack cinder-volume[86063]: INFO dbcounter [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] Registered counter for database cinder
Sep 29 12:22:08 devstack cinder-volume[86063]: DEBUG oslo_db.sqlalchemy.engines [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86063) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG dbcounter [-] [86063] Writer thread running {{(pid=86063) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 12:22:09 devstack cinder-volume[86063]: INFO cinder.rpc [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 29 12:22:09 devstack cinder-volume[86063]: INFO cinder.rpc [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_db.sqlalchemy.engines [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86063) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:22:09 devstack cinder-volume[86063]: INFO cinder.volume.manager [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] Determined volume DB was empty at startup.
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG cinder.volume.manager [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86063) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 29 12:22:09 devstack cinder-volume[86063]: WARNING stevedore.named [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 29 12:22:09 devstack cinder-volume[86063]: WARNING castellan.key_manager [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 12:22:09 devstack cinder-volume[86063]: WARNING cinder.keymgr.conf_key_mgr [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 12:22:09 devstack cinder-volume[86063]: INFO cinder.volume.manager [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_db.sqlalchemy.engines [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86063) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:22:09 devstack cinder-volume[86063]: INFO oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] Starting 1 workers
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] Started child 86369 {{(pid=86063) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] Full set of CONF: {{(pid=86063) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] ******************************************************************************** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] Configuration options gathered from: {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] ================================================================================ {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] allow_availability_zone_fallback = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] allow_compression_on_image_upload = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] allowed_direct_url_schemes     = [] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] api_rate_limit                 = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] auth_strategy                  = keystone {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_availability_zone      = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_host                   = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_name                   = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_stats_polling_interval = 60 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backup_api_class               = cinder.backup.api.API {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86369]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0)
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backup_name_template           = backup-%s {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backup_use_same_host           = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backup_use_temp_snapshot       = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] chap_password                  = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] chap_username                  =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cinder_internal_tenant_project_id = 2a8f25f1a76341f7aaf1a6475529e5ae {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cinder_internal_tenant_user_id = c17de904ad8446b9a19c81b828f9fef9 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cluster                        = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] compression_format             = gzip {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] config_dir                     = [] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] config_source                  = [] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] control_exchange               = openstack {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] debug                          = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] default_availability_zone      = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] default_group_type             = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] default_volume_type            = QuobyteHD {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] disk_geometry                  = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] driver_client_cert             = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] driver_client_cert_key         = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] driver_data_namespace          = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] driver_ssl_cert_path           = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] driver_ssl_cert_verify         = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] driver_use_ssl                 = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] enable_new_services            = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] enable_unsupported_driver      = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] enforce_multipath_for_image_xfer = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] filter_function                = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance_api_insecure            = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance_api_servers             = ['http://192.168.122.30/image'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance_api_ssl_compression     = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance_ca_certificates_file    = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance_certfile                = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance_keyfile                 = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance_num_retries             = 3 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance_request_timeout         = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] goodness_function              = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] graceful_shutdown_timeout      = 5 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] group_api_class                = cinder.group.api.API {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] host                           = devstack {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] image_compress_on_upload       = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] image_conversion_address_space_limit = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] image_conversion_cpu_limit     = 60 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] image_conversion_disable       = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] image_introspection_address_space_limit = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] image_introspection_cpu_limit  = 60 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] image_upload_use_cinder_backend = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] image_upload_use_internal_tenant = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] image_volume_cache_enabled     = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] image_volume_cache_max_count   = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] image_volume_cache_max_size_gb = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] init_host_max_objects_retrieval = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] iscsi_target_flags             =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] iscsi_write_cache              = on {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] iser_helper                    = tgtadm {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] iser_ip_address                = 192.168.122.30 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] iser_port                      = 3260 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] log_color                      = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] log_config_append              = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] log_dir                        = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] log_file                       = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] log_options                    = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] log_rotate_interval            = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] log_rotate_interval_type       = days {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] log_rotation_type              = none {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] max_age                        = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] max_logfile_count              = 30 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] max_logfile_size_mb            = 200 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] max_over_subscription_ratio    = 20.0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] message_reap_interval          = 86400 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] message_ttl                    = 2592000 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] migration_create_volume_timeout_secs = 300 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] monkey_patch                   = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] monkey_patch_modules           = [] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] my_ip                          = 192.168.122.30 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] no_snapshot_gb_quota           = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] num_iser_scan_tries            = 3 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] num_shell_tries                = 3 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] num_volume_device_scan_tries   = 3 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] nvmeof_conn_info_version       = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] nvmet_ns_id                    = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] nvmet_port_id                  = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] osapi_max_limit                = 1000 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] osapi_volume_ext_list          = [] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] osapi_volume_listen_port       = 8776 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] osapi_volume_use_ssl           = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] osapi_volume_workers           = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] per_volume_size_limit          = -1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] periodic_fuzzy_delay           = 60 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] periodic_interval              = 60 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] public_endpoint                = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] publish_errors                 = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] quota_backup_gigabytes         = 1000 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] quota_backups                  = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] quota_gigabytes                = 1000 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] quota_groups                   = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] quota_snapshots                = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] quota_volumes                  = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] rate_limit_burst               = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] rate_limit_except_level        = CRITICAL {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] rate_limit_interval            = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] reinit_driver_count            = 3 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] replication_device             = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] report_discard_supported       = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] report_interval                = 120 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] reservation_clean_interval     = 86400 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86369) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] reservation_expire             = 86400 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] reserved_image_namespaces      = [] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] reserved_percentage            = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] rpc_response_timeout           = 120 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] run_external_periodic_tasks    = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] scst_target_driver             = iscsi {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] scst_target_iqn_name           = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_down_time              = 720 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] shell_completion               = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] snapshot_name_template         = snapshot-%s {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] split_loggers                  = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] state_path                     = /opt/stack/data/cinder {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] storage_availability_zone      = nova {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] storage_protocol               = iSCSI {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] syslog_log_facility            = LOG_USER {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] target_helper                  = lioadm {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] target_ip_address              = 192.168.122.30 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] target_port                    = 3260 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] target_protocol                = iscsi {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] target_secondary_ip_addresses  = [] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] trace_flags                    = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] transport_url                  = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] until_refresh                  = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] use_chap_auth                  = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] use_default_quota_class        = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] use_journal                    = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] use_json                       = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] use_multipath_for_image_xfer   = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] use_stderr                     = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] use_syslog                     = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] verify_glance_signatures       = enabled {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volume_api_class               = cinder.volume.api.API {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volume_backend_name            = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volume_clear                   = zero {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volume_clear_ionice            = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volume_clear_size              = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volume_copy_bps_limit          = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volume_dd_blocksize            = 1M {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volume_name_template           = volume-%s {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volume_service_inithost_offload = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volume_usage_audit_period      = month {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] zoning_mode                    = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_concurrency.disable_process_locking = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.auth_section = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.auth_type   = password {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.auth_version = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.cache       = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.certfile    = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.include_service_catalog = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.insecure    = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.interface   = public {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.keyfile     = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_password = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcache_username = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.region_name = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.service_type = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.30/identity {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.backend                  = dogpile.cache.null {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.backend_argument         = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.backend_expiration_time  = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.config_prefix            = cache.oslo {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.debug_cache_backend      = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.enable_retry_client      = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.enable_socket_keepalive  = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.enabled                  = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.expiration_time          = 600 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.hashclient_retry_attempts = 2 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.memcache_dead_retry      = 300 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.memcache_sasl_enabled    = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.password                 = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.proxies                  = [] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.redis_db                 = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.redis_server             = localhost:6379 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.retry_attempts           = 2 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.retry_delay              = 0.0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.socket_keepalive_count   = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.socket_keepalive_idle    = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.socket_keepalive_interval = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.socket_timeout           = 1.0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.tls_allowed_ciphers      = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.tls_cafile               = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.tls_certfile             = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.tls_enabled              = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.tls_keyfile              = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86369) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cache.username                 = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.quobyte [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] coordination.backend_url       = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.asyncio_connection    = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.asyncio_slave_connection = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.backend               = sqlalchemy {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.connection            = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.connection_debug      = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.quobyte [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.connection_parameters =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.connection_recycle_time = 3600 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.connection_trace      = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.db_inc_retry_interval = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.db_max_retries        = 20 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Running cmd (subprocess): mount.quobyte {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.db_max_retry_interval = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.db_retry_interval     = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.max_overflow          = 50 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.max_pool_size         = 5 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.max_retries           = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.mysql_wsrep_sync_wait = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.pool_timeout          = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.retry_interval        = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.slave_connection      = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.sqlite_synchronous    = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.synchronous_reader    = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] database.use_db_reconnect      = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_tracing.insecure = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler.connection_string     = messaging:// {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler.enabled               = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler.es_doc_type           = notification {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler.es_scroll_size        = 10000 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler.es_scroll_time        = 2m {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler.filter_error_trace    = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler.hmac_keys             = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler.sentinel_service_name = mymaster {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler.socket_timeout        = 0.1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler.trace_requests        = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler.trace_sqlalchemy      = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler_jaeger.process_tags   = {} {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler_jaeger.service_name_prefix = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] profiler_otlp.service_name_prefix = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_policy.enforce_new_defaults = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_policy.policy_default_rule = default {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] privsep_osbrick.group          = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] privsep_osbrick.helper_command = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] privsep_osbrick.user           = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cinder_sys_admin.group         = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cinder_sys_admin.helper_command = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] cinder_sys_admin.user          = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_user.auth_section      = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_user.auth_type         = password {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_user.cafile            = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_user.certfile          = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_user.collect_timing    = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_user.insecure          = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_user.keyfile           = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_user.send_service_user_token = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_user.split_loggers     = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_user.timeout           = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_user.tls_ciphers       = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] service_user.tls_min_version   = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance.auth_section            = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance.auth_type               = password {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance.certfile                = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance.collect_timing          = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance.insecure                = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance.keyfile                 = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance.region_name             = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance.split_loggers           = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance.timeout                 = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance.tls_ciphers             = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] glance.tls_min_version         = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.backend_availability_zone = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.chap_password = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.chap_username =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.disk_geometry = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.driver_client_cert = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.driver_client_cert_key = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.driver_data_namespace = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.driver_use_ssl = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.extra_capabilities = {} {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.filter_function = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.goodness_function = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.iscsi_target_flags =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.iscsi_write_cache = on {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.iser_ip_address = 192.168.122.30 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.iser_port     = 3260 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nas_host      =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nas_login     = admin {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nas_mount_options = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nas_password  = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nas_private_key =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nas_share_path =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.num_shell_tries = 3 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.quobyte_volume_url = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.replication_device = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.report_discard_supported = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.reserved_percentage = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.target_helper = tgtadm {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.target_ip_address = 192.168.122.30 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.target_port   = 3260 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.target_protocol = iscsi {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.trace_flags   = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.unique_fqdn_network = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.use_chap_auth = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.volume_backend_name = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.volume_clear  = zero {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.volume_clear_ionice = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.volume_clear_size = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_reports.file_event_handler = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_reports.log_dir           = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.backend_availability_zone = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack quobyte-client[86370]: Reading configuration file: /etc/quobyte/client.cfg
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.backend_host         = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack quobyte-client[86370]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.chap_password        = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.chap_username        = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.disk_geometry        = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.driver_client_cert   = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.driver_data_namespace = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.extra_capabilities   = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.filter_function      = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.goodness_function    = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.iser_helper          = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.iser_ip_address      = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.iser_port            = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nas_host             = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nas_login            = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nas_mount_options    = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nas_password         = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nas_private_key      = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nas_share_path       = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.num_shell_tries      = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.replication_device   = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.report_discard_supported = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.reserved_percentage  = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.scst_target_driver   = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.storage_protocol     = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.target_helper        = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.target_ip_address    = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.target_port          = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.target_prefix        = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.target_protocol      = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.trace_flags          = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.use_chap_auth        = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.volume_clear         = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.volume_clear_size    = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] QuobyteHD.volumes_dir          = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack sudo[86371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_notifications.driver = [] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_notifications.retry = -1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] key_manager.fixed_key          = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.barbican_api_version  = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.barbican_endpoint     = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.barbican_endpoint_type = public {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.barbican_region_name  = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.cafile                = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.certfile              = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.collect_timing        = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.insecure              = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.keyfile               = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.number_of_retries     = 60 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.retry_delay           = 1 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.send_service_user_token = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.split_loggers         = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.timeout               = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.tls_ciphers           = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.tls_min_version       = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.verify_ssl            = True {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican.verify_ssl_path       = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican_service_user.auth_section = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican_service_user.auth_type = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican_service_user.cafile   = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican_service_user.certfile = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican_service_user.collect_timing = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican_service_user.insecure = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican_service_user.keyfile  = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican_service_user.split_loggers = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican_service_user.timeout  = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican_service_user.tls_ciphers = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] barbican_service_user.tls_min_version = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.approle_role_id          = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.approle_secret_id        = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.auth_method              = approle {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.auth_path                = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.kv_mountpoint            = secret {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.kv_path                  = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.kv_version               = 2 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.namespace                = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.root_token_id            = **** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.ssl_ca_crt_file          = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.timeout                  = 60.0 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.token_file               = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.token_role               = None {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.use_ssl                  = False {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 12:22:09 devstack cinder-volume[86063]: DEBUG oslo_service.backend._eventlet.service [None req-6c4b75db-b429-460f-aaab-7d4496673f99 None None] ******************************************************************************** {{(pid=86063) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 29 12:22:10 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:22:10 devstack cinder-volume[86369]: INFO cinder.volume.driver [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Driver hasn't implemented _init_vendor_properties()
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG cinder.volume.driver [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0505638122559, 'free_capacity_gb': 1775.0505638122559, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86369) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG oslo_db.sqlalchemy.engines [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86369) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writer thread running {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG cinder.db.api [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Building query based on filter {{(pid=86369) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86369) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:22:10 devstack cinder-volume[86369]: INFO cinder.keymgr.migration [None req-ffa04449-d59c-438e-ba26-dcd37afbd4a2 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 29 12:22:10 devstack sudo[86384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:22:10 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:22:10 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.236s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:22:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Driver initialization completed successfully.
Sep 29 12:22:10 devstack cinder-volume[86369]: INFO cinder.manager [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Initiating service 3 cleanup
Sep 29 12:22:10 devstack cinder-volume[86369]: INFO cinder.manager [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Service 3 cleanup completed.
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG cinder.service [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Creating RPC server for service cinder-volume {{(pid=86369) start /opt/stack/cinder/cinder/service.py:231}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG cinder.service [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86369) start /opt/stack/cinder/cinder/service.py:237}}
Sep 29 12:22:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:22:10 devstack sudo[86395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:22:10 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:22:10 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root
Sep 29 12:22:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.241s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:22:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4ce52989-441e-477f-b5e7-eb15c5dde563 None None] Driver post RPC initialization completed successfully.
Sep 29 12:22:19 devstack cinder-volume[86063]: DEBUG dbcounter [-] [86063] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86063) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:22:20 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:22:20 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=3 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:23:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:23:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 6 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:23:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Flow 'volume_create_manager' (a02e2e6a-2168-4800-bb96-e630c993d048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc30ac4c-e951-495f-a55e-85c9b80f4fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc30ac4c-e951-495f-a55e-85c9b80f4fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-472503751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903e618a-6894-4df6-a836-6b79ae24041d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689f00ca3cdd471ba817102748e75772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:23:35Z,use_quota=True,user_id='9d3e1e5a9a5c489f8a7acb725e6c8427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc271838-4f34-4d1c-82a0-061216d287c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc271838-4f34-4d1c-82a0-061216d287c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5efa53-da4a-4185-93c8-b4d1665be20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5efa53-da4a-4185-93c8-b4d1665be20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903e618a-6894-4df6-a836-6b79ae24041d', 'volume_name': 'volume-903e618a-6894-4df6-a836-6b79ae24041d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d541869b-00e4-457d-bf5f-880769b99c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d541869b-00e4-457d-bf5f-880769b99c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf461ed-2c19-47ea-95f7-c00e451a77db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:34 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Volume 903e618a-6894-4df6-a836-6b79ae24041d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903e618a-6894-4df6-a836-6b79ae24041d', 'volume_size': 1}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-472503751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903e618a-6894-4df6-a836-6b79ae24041d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689f00ca3cdd471ba817102748e75772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:23:35Z,use_quota=True,user_id='9d3e1e5a9a5c489f8a7acb725e6c8427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Creating volume 903e618a-6894-4df6-a836-6b79ae24041d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:23:34 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:23:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-903e618a-6894-4df6-a836-6b79ae24041d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:23:34 devstack sudo[87217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-903e618a-6894-4df6-a836-6b79ae24041d 1073741824
Sep 29 12:23:34 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:23:36 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root
Sep 29 12:23:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-903e618a-6894-4df6-a836-6b79ae24041d 1073741824" returned: 0 in 1.299s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:23:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-903e618a-6894-4df6-a836-6b79ae24041d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:23:36 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-903e618a-6894-4df6-a836-6b79ae24041d
Sep 29 12:23:36 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:23:36 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Sep 29 12:23:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-903e618a-6894-4df6-a836-6b79ae24041d" returned: 0 in 0.552s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:23:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:23:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:23:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf461ed-2c19-47ea-95f7-c00e451a77db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903e618a-6894-4df6-a836-6b79ae24041d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246f0983-d711-43ec-8441-8fb2bd538648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Volume volume-903e618a-6894-4df6-a836-6b79ae24041d (903e618a-6894-4df6-a836-6b79ae24041d): created successfully
Sep 29 12:23:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246f0983-d711-43ec-8441-8fb2bd538648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Flow 'volume_create_manager' (a02e2e6a-2168-4800-bb96-e630c993d048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:23:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8eb8e486-bcf2-4f20-bc6e-1759d4d6e299 tempest-VolumesAdminNegativeTest-946705090 None] Created volume successfully.
Sep 29 12:23:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Acquiring lock "cinder-903e618a-6894-4df6-a836-6b79ae24041d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:23:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Lock "cinder-903e618a-6894-4df6-a836-6b79ae24041d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:23:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Acquiring lock "cinder-quobyte-903e618a-6894-4df6-a836-6b79ae24041d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:23:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Lock "cinder-quobyte-903e618a-6894-4df6-a836-6b79ae24041d" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:23:38 devstack cinder-volume[86369]: INFO oslo.privsep.daemon [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppr0ykup1/privsep.sock']
Sep 29 12:23:38 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppr0ykup1/privsep.sock
Sep 29 12:23:38 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:23:39 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 29 12:23:39 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 29 12:23:39 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 29 12:23:39 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 29 12:23:39 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 29 12:23:39 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 29 12:23:39 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 29 12:23:39 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 29 12:23:39 devstack cinder-volume[86369]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 29 12:23:40 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Sep 29 12:23:40 devstack cinder-volume[86369]: INFO oslo.privsep.daemon [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Spawned new privsep daemon via rootwrap
Sep 29 12:23:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Accepted privsep connection to /tmp/tmppr0ykup1/privsep.sock {{(pid=86369) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 29 12:23:40 devstack cinder-volume[86369]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 29 12:23:40 devstack cinder-volume[86369]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 29 12:23:40 devstack cinder-volume[86369]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 29 12:23:40 devstack cinder-volume[86369]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87610
Sep 29 12:23:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d822768c-1d7a-4b10-bbab-db242fcc8c2a]: (2,) {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:23:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0f905e-dd12-47bf-b382-b22073ccddb0]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:23:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-903e618a-6894-4df6-a836-6b79ae24041d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:23:40 devstack sudo[87612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-903e618a-6894-4df6-a836-6b79ae24041d
Sep 29 12:23:40 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:23:40 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root
Sep 29 12:23:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-903e618a-6894-4df6-a836-6b79ae24041d" returned: 0 in 0.398s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:23:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-903e618a-6894-4df6-a836-6b79ae24041d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:23:40 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-903e618a-6894-4df6-a836-6b79ae24041d
Sep 29 12:23:40 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:23:40 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Sep 29 12:23:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-903e618a-6894-4df6-a836-6b79ae24041d" returned: 0 in 0.247s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:23:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Lock "cinder-quobyte-903e618a-6894-4df6-a836-6b79ae24041d" released by "delete_volume" :: held 1.993s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:23:40 devstack cinder-volume[86369]: WARNING cinder.quota [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:23:40 devstack cinder-volume[86369]: WARNING cinder.quota [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:23:40 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Created reservations ['cace2524-f7b3-41be-8065-cbd8099eb87e', 'fee4d4bb-8299-4067-b9c8-536362f1105a', '16ef4808-c88c-47f1-a262-d2000f9f0821', '6eaa911c-05fe-4622-938a-19a12765a29f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:23:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:23:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:23:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:23:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:23:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:23:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:23:41 devstack sudo[87620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:23:41 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:23:41 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root
Sep 29 12:23:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.320s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:23:41 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:23:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Deleted volume successfully.
Sep 29 12:23:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-482044db-dca4-4773-acfa-020f5bc268fb tempest-VolumesAdminNegativeTest-946705090 None] Lock "cinder-903e618a-6894-4df6-a836-6b79ae24041d-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Flow 'volume_create_manager' (a7bca7f3-2a8b-4960-ab04-124fbcbfee8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16e9c42-9f7b-4343-a1ce-921c099e0f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16e9c42-9f7b-4343-a1ce-921c099e0f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-530350398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492a05a4-92f5-465b-a277-9e7b28b4a914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84d11bb65ee47fdac36a4fca5a18bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:23:48Z,use_quota=True,user_id='3e2133869595410fbc21577a93eab3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c94ebd9-02e3-4ea4-b560-f1ceaa0ee2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c94ebd9-02e3-4ea4-b560-f1ceaa0ee2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea5ba5d-f883-4b2c-be94-06e1aa57593c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea5ba5d-f883-4b2c-be94-06e1aa57593c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '492a05a4-92f5-465b-a277-9e7b28b4a914', 'volume_name': 'volume-492a05a4-92f5-465b-a277-9e7b28b4a914', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4269c2d0-ad61-4a90-abff-2bea2a835343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4269c2d0-ad61-4a90-abff-2bea2a835343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5688fef6-d991-44fb-882e-2570d56e67ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:48 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Volume 492a05a4-92f5-465b-a277-9e7b28b4a914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-492a05a4-92f5-465b-a277-9e7b28b4a914', 'volume_size': 1}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-530350398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492a05a4-92f5-465b-a277-9e7b28b4a914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84d11bb65ee47fdac36a4fca5a18bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:23:48Z,use_quota=True,user_id='3e2133869595410fbc21577a93eab3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Creating volume 492a05a4-92f5-465b-a277-9e7b28b4a914 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:23:48 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-492a05a4-92f5-465b-a277-9e7b28b4a914 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:23:48 devstack sudo[87697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-492a05a4-92f5-465b-a277-9e7b28b4a914 1073741824
Sep 29 12:23:48 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:23:48 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-492a05a4-92f5-465b-a277-9e7b28b4a914 1073741824" returned: 0 in 0.593s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:23:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-492a05a4-92f5-465b-a277-9e7b28b4a914 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:23:48 devstack sudo[87706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-492a05a4-92f5-465b-a277-9e7b28b4a914
Sep 29 12:23:48 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:23:49 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root
Sep 29 12:23:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-492a05a4-92f5-465b-a277-9e7b28b4a914" returned: 0 in 0.458s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:23:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:23:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:23:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5688fef6-d991-44fb-882e-2570d56e67ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492a05a4-92f5-465b-a277-9e7b28b4a914', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464e70d1-04c6-4647-82a1-91d9aeee34c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Volume volume-492a05a4-92f5-465b-a277-9e7b28b4a914 (492a05a4-92f5-465b-a277-9e7b28b4a914): created successfully
Sep 29 12:23:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464e70d1-04c6-4647-82a1-91d9aeee34c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Flow 'volume_create_manager' (a7bca7f3-2a8b-4960-ab04-124fbcbfee8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:23:49 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c789e73a-99c4-4ab7-b271-607f31809a18 tempest-AttachVolumeShelveTestJSON-219583082 None] Created volume successfully.
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Flow 'volume_create_manager' (9571ac36-4f81-42aa-9b57-462528f79348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db98e70d-bd3d-4d94-9a3d-cca0167b0f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db98e70d-bd3d-4d94-9a3d-cca0167b0f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-933715808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ebda30-86e7-4296-a28e-25b53c9645de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5224be9c72747798faac84f2808c23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:23:50Z,use_quota=True,user_id='55a705bc1918410fa5540721ffd39ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4da842-ad8c-4d0c-b860-95f6987a58a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4da842-ad8c-4d0c-b860-95f6987a58a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1b1592-2fe7-48b5-a184-f2299f3e26cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1b1592-2fe7-48b5-a184-f2299f3e26cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ebda30-86e7-4296-a28e-25b53c9645de', 'volume_name': 'volume-f7ebda30-86e7-4296-a28e-25b53c9645de', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a4f5b1-cf06-4067-b262-9a90f07837e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a4f5b1-cf06-4067-b262-9a90f07837e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f05c0da-e6cd-402a-85d9-0b039e3342de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:50 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Volume f7ebda30-86e7-4296-a28e-25b53c9645de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ebda30-86e7-4296-a28e-25b53c9645de', 'volume_size': 1}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-933715808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ebda30-86e7-4296-a28e-25b53c9645de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5224be9c72747798faac84f2808c23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:23:50Z,use_quota=True,user_id='55a705bc1918410fa5540721ffd39ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Creating volume f7ebda30-86e7-4296-a28e-25b53c9645de {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:23:50 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:23:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7ebda30-86e7-4296-a28e-25b53c9645de 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:23:50 devstack sudo[87712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7ebda30-86e7-4296-a28e-25b53c9645de 1073741824
Sep 29 12:23:50 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:23:51 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root
Sep 29 12:23:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7ebda30-86e7-4296-a28e-25b53c9645de 1073741824" returned: 0 in 0.693s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:23:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7ebda30-86e7-4296-a28e-25b53c9645de {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:23:51 devstack sudo[87720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7ebda30-86e7-4296-a28e-25b53c9645de
Sep 29 12:23:51 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:23:51 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root
Sep 29 12:23:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7ebda30-86e7-4296-a28e-25b53c9645de" returned: 0 in 0.356s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:23:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:23:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:23:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f05c0da-e6cd-402a-85d9-0b039e3342de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ebda30-86e7-4296-a28e-25b53c9645de', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5d03c3-c220-41bd-a245-0c96d31ed5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:23:51 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Volume volume-f7ebda30-86e7-4296-a28e-25b53c9645de (f7ebda30-86e7-4296-a28e-25b53c9645de): created successfully
Sep 29 12:23:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5d03c3-c220-41bd-a245-0c96d31ed5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:23:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Flow 'volume_create_manager' (9571ac36-4f81-42aa-9b57-462528f79348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:23:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-898311c9-1ea4-483a-bf9f-7995c2b3c475 tempest-ServerActionsTestOtherA-114144666 None] Created volume successfully.
Sep 29 12:24:01 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=11,cinder:UPDATE=22,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:24:01 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=12,cinder:SELECT=11,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:24:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:24:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:24:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:24:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:24:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:24:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:24:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:24:07 devstack sudo[87836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:24:07 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:24:08 devstack cinder-volume[86369]: WARNING py.warnings [req-ca190ae7-f25c-47c8-9372-7830e42514c1 req-3b5e7015-74c7-4ba7-8153-7cc4e414375a tempest-AttachVolumeShelveTestJSON-219583082 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Sep 29 12:24:08 devstack cinder-volume[86369]:   .first()
Sep 29 12:24:08 devstack cinder-volume[86369]: 
Sep 29 12:24:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-ca190ae7-f25c-47c8-9372-7830e42514c1 req-3b5e7015-74c7-4ba7-8153-7cc4e414375a tempest-AttachVolumeShelveTestJSON-219583082 None] No connector for attachment 9fd9190c-266c-43a4-ad8d-a3277a0d81e4; skipping storage backend terminate_connection call. {{(pid=86369) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 29 12:24:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-ca190ae7-f25c-47c8-9372-7830e42514c1 req-3b5e7015-74c7-4ba7-8153-7cc4e414375a tempest-AttachVolumeShelveTestJSON-219583082 None] Deleting attachment 9fd9190c-266c-43a4-ad8d-a3277a0d81e4. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:24:08 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root
Sep 29 12:24:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.433s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:24:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:24:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:24:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 8 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:24:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:24:20 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:24:20 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Flow 'volume_create_manager' (289c6000-fab7-420d-aead-35b02adb15d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a143564-19ce-44ea-9362-720385a92942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a143564-19ce-44ea-9362-720385a92942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-632567620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63e41c6-9736-4495-803b-aa08b37639ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4240258197e645238bdd0ac86852dba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:24:22Z,use_quota=True,user_id='c304de0327024d378b7251b93496c096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1424d6a5-48dc-4df4-abff-41812726f27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1424d6a5-48dc-4df4-abff-41812726f27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b848f79c-1e07-4f30-97ad-da70bb4a7f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b848f79c-1e07-4f30-97ad-da70bb4a7f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63e41c6-9736-4495-803b-aa08b37639ed', 'volume_name': 'volume-b63e41c6-9736-4495-803b-aa08b37639ed', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b18423-3fa7-408f-9207-6d0b2cdbf099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b18423-3fa7-408f-9207-6d0b2cdbf099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a70994-d8d6-424f-9897-97b7e1a6324c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:24:22 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Volume b63e41c6-9736-4495-803b-aa08b37639ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63e41c6-9736-4495-803b-aa08b37639ed', 'volume_size': 1}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-632567620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63e41c6-9736-4495-803b-aa08b37639ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4240258197e645238bdd0ac86852dba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:24:22Z,use_quota=True,user_id='c304de0327024d378b7251b93496c096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Creating volume b63e41c6-9736-4495-803b-aa08b37639ed {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:24:22 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:24:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b63e41c6-9736-4495-803b-aa08b37639ed 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:24:22 devstack sudo[88003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b63e41c6-9736-4495-803b-aa08b37639ed 1073741824
Sep 29 12:24:22 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:24:23 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root
Sep 29 12:24:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b63e41c6-9736-4495-803b-aa08b37639ed 1073741824" returned: 0 in 0.837s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:24:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b63e41c6-9736-4495-803b-aa08b37639ed {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:24:23 devstack sudo[88019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b63e41c6-9736-4495-803b-aa08b37639ed
Sep 29 12:24:23 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:24:23 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root
Sep 29 12:24:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b63e41c6-9736-4495-803b-aa08b37639ed" returned: 0 in 0.484s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:24:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:24:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:24:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a70994-d8d6-424f-9897-97b7e1a6324c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63e41c6-9736-4495-803b-aa08b37639ed', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:24:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed23259-e643-44bd-ad89-9eba9a6c92de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:24:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Volume volume-b63e41c6-9736-4495-803b-aa08b37639ed (b63e41c6-9736-4495-803b-aa08b37639ed): created successfully
Sep 29 12:24:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed23259-e643-44bd-ad89-9eba9a6c92de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:24:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Flow 'volume_create_manager' (289c6000-fab7-420d-aead-35b02adb15d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:24:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e213bc6c-8d82-4de9-b90a-a874aaf7ce65 tempest-DeleteServersTestJSON-1813644043 None] Created volume successfully.
Sep 29 12:24:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-f9d06446-8c0c-4d7a-a4a4-2452047f4a2d req-288a9bcf-b4de-4bf8-9b9f-9a7db34e7a9d tempest-DeleteServersTestJSON-1813644043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:24:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-f9d06446-8c0c-4d7a-a4a4-2452047f4a2d req-288a9bcf-b4de-4bf8-9b9f-9a7db34e7a9d tempest-DeleteServersTestJSON-1813644043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:24:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-f9d06446-8c0c-4d7a-a4a4-2452047f4a2d req-288a9bcf-b4de-4bf8-9b9f-9a7db34e7a9d tempest-DeleteServersTestJSON-1813644043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:24:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-f9d06446-8c0c-4d7a-a4a4-2452047f4a2d req-288a9bcf-b4de-4bf8-9b9f-9a7db34e7a9d tempest-DeleteServersTestJSON-1813644043 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-b63e41c6-9736-4495-803b-aa08b37639ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72d32aa3-3c8d-4778-810b-412fdf36b9ed', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:24:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-f9d06446-8c0c-4d7a-a4a4-2452047f4a2d req-288a9bcf-b4de-4bf8-9b9f-9a7db34e7a9d tempest-DeleteServersTestJSON-1813644043 None] attachment_update completed successfully.
Sep 29 12:24:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-90524c0a-fd80-47e7-91fc-33431161084a req-6f28e7ac-1cfd-4c36-b418-ae499a4b544a tempest-DeleteServersTestJSON-1813644043 None] Terminate volume connection completed successfully.
Sep 29 12:24:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-90524c0a-fd80-47e7-91fc-33431161084a req-6f28e7ac-1cfd-4c36-b418-ae499a4b544a tempest-DeleteServersTestJSON-1813644043 None] Deleting attachment 72d32aa3-3c8d-4778-810b-412fdf36b9ed. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:24:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Acquiring lock "cinder-b63e41c6-9736-4495-803b-aa08b37639ed-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:24:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Lock "cinder-b63e41c6-9736-4495-803b-aa08b37639ed-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:24:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Acquiring lock "cinder-quobyte-b63e41c6-9736-4495-803b-aa08b37639ed" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:24:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Lock "cinder-quobyte-b63e41c6-9736-4495-803b-aa08b37639ed" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:24:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdebe7b-8b55-4568-896c-c5141eec0752]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:24:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b63e41c6-9736-4495-803b-aa08b37639ed {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:24:39 devstack sudo[88693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b63e41c6-9736-4495-803b-aa08b37639ed
Sep 29 12:24:39 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:24:39 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root
Sep 29 12:24:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b63e41c6-9736-4495-803b-aa08b37639ed" returned: 0 in 0.478s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:24:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b63e41c6-9736-4495-803b-aa08b37639ed {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:24:39 devstack sudo[88701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b63e41c6-9736-4495-803b-aa08b37639ed
Sep 29 12:24:39 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:24:40 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b63e41c6-9736-4495-803b-aa08b37639ed" returned: 0 in 0.415s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Lock "cinder-quobyte-b63e41c6-9736-4495-803b-aa08b37639ed" released by "delete_volume" :: held 0.973s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Created reservations ['8db4f322-ecf8-4f05-8720-02c415e316af', '24f9af86-db28-4087-bdfe-4127015d9489', '86732983-027f-425c-9047-5d01a3d1e603', 'b6a75939-9508-4885-b86b-635bbe034638'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-a927495e-4d15-4ef9-9df1-a74aadada335 req-1b1faf24-e877-4d95-bd27-4db034d428d0 tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-a927495e-4d15-4ef9-9df1-a74aadada335 req-1b1faf24-e877-4d95-bd27-4db034d428d0 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-a927495e-4d15-4ef9-9df1-a74aadada335 req-1b1faf24-e877-4d95-bd27-4db034d428d0 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-a927495e-4d15-4ef9-9df1-a74aadada335 req-1b1faf24-e877-4d95-bd27-4db034d428d0 tempest-ServerActionsTestOtherA-114144666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-f7ebda30-86e7-4296-a28e-25b53c9645de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40151fee-81bd-4752-b089-e72e36dc0d89', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:24:40 devstack sudo[88714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:24:40 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:24:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-a927495e-4d15-4ef9-9df1-a74aadada335 req-1b1faf24-e877-4d95-bd27-4db034d428d0 tempest-ServerActionsTestOtherA-114144666 None] attachment_update completed successfully.
Sep 29 12:24:40 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:24:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Deleted volume successfully.
Sep 29 12:24:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf9dc8bf-cdf5-41d0-989e-6b4f003d2c68 tempest-DeleteServersTestJSON-1813644043 None] Lock "cinder-b63e41c6-9736-4495-803b-aa08b37639ed-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:24:46 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-c1b6eb82-a6bd-4062-a2d7-66b8014c5587 req-722bda27-31e2-4cf3-89c3-dbe49be48676 tempest-ServerActionsTestOtherA-114144666 None] Terminate volume connection completed successfully.
Sep 29 12:24:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-c1b6eb82-a6bd-4062-a2d7-66b8014c5587 req-722bda27-31e2-4cf3-89c3-dbe49be48676 tempest-ServerActionsTestOtherA-114144666 None] Deleting attachment 40151fee-81bd-4752-b089-e72e36dc0d89. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:24:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c1b6eb82-a6bd-4062-a2d7-66b8014c5587 req-21004a0e-da14-42cf-aacb-51dc4e54e0c7 tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:24:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c1b6eb82-a6bd-4062-a2d7-66b8014c5587 req-21004a0e-da14-42cf-aacb-51dc4e54e0c7 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:24:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c1b6eb82-a6bd-4062-a2d7-66b8014c5587 req-21004a0e-da14-42cf-aacb-51dc4e54e0c7 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:24:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-c1b6eb82-a6bd-4062-a2d7-66b8014c5587 req-21004a0e-da14-42cf-aacb-51dc4e54e0c7 tempest-ServerActionsTestOtherA-114144666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-f7ebda30-86e7-4296-a28e-25b53c9645de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5788ba4-0011-4acb-9055-cac0cf6fb724', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:24:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-c1b6eb82-a6bd-4062-a2d7-66b8014c5587 req-21004a0e-da14-42cf-aacb-51dc4e54e0c7 tempest-ServerActionsTestOtherA-114144666 None] attachment_update completed successfully.
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Flow 'volume_create_manager' (6b1d2ddb-c14a-43dc-85c2-b950a4aa3dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227ab956-e1f9-412b-a228-957dcf13e09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227ab956-e1f9-412b-a228-957dcf13e09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1842315470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c152606-8a07-4d49-b706-087d62e79196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea5b67f0f1842e7ae4815759a675b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:24:57Z,use_quota=True,user_id='19e36374e7ff49e19969a3a4c57c2bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb1258b-f7a9-456d-92fb-8be83aa380c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb1258b-f7a9-456d-92fb-8be83aa380c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6aaa3c-f375-41d0-88d7-35dc2b5dcf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6aaa3c-f375-41d0-88d7-35dc2b5dcf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c152606-8a07-4d49-b706-087d62e79196', 'volume_name': 'volume-3c152606-8a07-4d49-b706-087d62e79196', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5754b0e0-524d-4027-8dfb-526613faab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5754b0e0-524d-4027-8dfb-526613faab92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a2fef5-9935-4ce7-8637-ffaa4e14a553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:24:56 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Volume 3c152606-8a07-4d49-b706-087d62e79196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c152606-8a07-4d49-b706-087d62e79196', 'volume_size': 1}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1842315470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c152606-8a07-4d49-b706-087d62e79196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea5b67f0f1842e7ae4815759a675b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:24:57Z,use_quota=True,user_id='19e36374e7ff49e19969a3a4c57c2bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Creating volume 3c152606-8a07-4d49-b706-087d62e79196 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:24:56 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:24:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3c152606-8a07-4d49-b706-087d62e79196 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:24:56 devstack sudo[89763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3c152606-8a07-4d49-b706-087d62e79196 1073741824
Sep 29 12:24:56 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:24:57 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root
Sep 29 12:24:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3c152606-8a07-4d49-b706-087d62e79196 1073741824" returned: 0 in 0.666s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:24:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3c152606-8a07-4d49-b706-087d62e79196 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:24:57 devstack sudo[89771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3c152606-8a07-4d49-b706-087d62e79196
Sep 29 12:24:57 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:24:57 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root
Sep 29 12:24:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3c152606-8a07-4d49-b706-087d62e79196" returned: 0 in 0.468s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:24:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:24:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:24:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a2fef5-9935-4ce7-8637-ffaa4e14a553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c152606-8a07-4d49-b706-087d62e79196', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:24:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87b0472-4e89-4a4a-ac64-74f781b3145b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:24:57 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Volume volume-3c152606-8a07-4d49-b706-087d62e79196 (3c152606-8a07-4d49-b706-087d62e79196): created successfully
Sep 29 12:24:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87b0472-4e89-4a4a-ac64-74f781b3145b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:24:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Flow 'volume_create_manager' (6b1d2ddb-c14a-43dc-85c2-b950a4aa3dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:24:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-850756cc-22fc-44ab-a4bb-05bd20c382d8 tempest-TaggedAttachmentsTest-579971402 None] Created volume successfully.
Sep 29 12:25:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Acquiring lock "cinder-492a05a4-92f5-465b-a277-9e7b28b4a914-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:25:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Lock "cinder-492a05a4-92f5-465b-a277-9e7b28b4a914-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:25:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Acquiring lock "cinder-quobyte-492a05a4-92f5-465b-a277-9e7b28b4a914" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:25:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Lock "cinder-quobyte-492a05a4-92f5-465b-a277-9e7b28b4a914" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:25:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f53fe7f-9997-4d64-b67e-2e67e9f81371]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:25:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-492a05a4-92f5-465b-a277-9e7b28b4a914 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:05 devstack sudo[90135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-492a05a4-92f5-465b-a277-9e7b28b4a914
Sep 29 12:25:05 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:06 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-492a05a4-92f5-465b-a277-9e7b28b4a914" returned: 0 in 0.522s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-492a05a4-92f5-465b-a277-9e7b28b4a914 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:06 devstack sudo[90146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-492a05a4-92f5-465b-a277-9e7b28b4a914
Sep 29 12:25:06 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:06 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-492a05a4-92f5-465b-a277-9e7b28b4a914" returned: 0 in 0.398s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Lock "cinder-quobyte-492a05a4-92f5-465b-a277-9e7b28b4a914" released by "delete_volume" :: held 1.019s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:25:06 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Created reservations ['34667a0d-ac84-44f2-a8e9-807387db1e99', '9d5296c1-2b5c-4b59-8904-acc4265098c4', '9f0c35d5-542e-48d3-ac02-bba2fa3fd90d', '841a6795-84f3-4084-a6d7-18b0e5c9933a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:25:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:25:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:25:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:25:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:25:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:25:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:06 devstack sudo[90149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:25:06 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:06 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.289s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:07 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:25:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Deleted volume successfully.
Sep 29 12:25:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-756834ee-addb-4b44-b367-9091079504d3 tempest-AttachVolumeShelveTestJSON-219583082 None] Lock "cinder-492a05a4-92f5-465b-a277-9e7b28b4a914-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:25:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:25:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:25:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:25:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:25:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:25:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:25:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:07 devstack sudo[90160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:25:07 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:08 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.388s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:25:16 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=40,cinder:UPDATE=29,cinder:INSERT=5 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:25:17 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=24,cinder:SELECT=31,cinder:INSERT=5,cinder:DELETE=4 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:25:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-c402e437-90fe-4184-aa1a-31102533cac0 req-2581753e-d58f-4a7b-b65b-b0cab7312c50 tempest-ServerActionsTestOtherA-114144666 None] Terminate volume connection completed successfully.
Sep 29 12:25:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-c402e437-90fe-4184-aa1a-31102533cac0 req-2581753e-d58f-4a7b-b65b-b0cab7312c50 tempest-ServerActionsTestOtherA-114144666 None] Deleting attachment f5788ba4-0011-4acb-9055-cac0cf6fb724. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:25:29 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:25:29 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Flow 'volume_create_manager' (b93378a5-6dd7-4507-bdd5-1e7d1b6dede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc0763a-9e8e-4bae-af2d-bc6ad40c7dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc0763a-9e8e-4bae-af2d-bc6ad40c7dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-116185721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce88f127-3a4c-41f2-a500-9fe6cf51c64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5224be9c72747798faac84f2808c23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:25:35Z,use_quota=True,user_id='55a705bc1918410fa5540721ffd39ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25e9b89-7ba8-4cd0-8558-5d503f1aee08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25e9b89-7ba8-4cd0-8558-5d503f1aee08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0292f8c-5aec-4784-a647-c313c0e03c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0292f8c-5aec-4784-a647-c313c0e03c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce88f127-3a4c-41f2-a500-9fe6cf51c64d', 'volume_name': 'volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b7025681d00>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bc2b2d-8a2d-4ec7-bf73-c7d7c3c17d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bc2b2d-8a2d-4ec7-bf73-c7d7c3c17d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f27d583e-5861-483f-ab8d-32a0aa60e47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:25:35 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Volume ce88f127-3a4c-41f2-a500-9fe6cf51c64d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b7025681d00>}
Sep 29 12:25:35 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Trying to clone ce88f127-3a4c-41f2-a500-9fe6cf51c64d from image f8e17489-d113-49d7-ab01-94ac91f04646 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 12:25:36 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 12:25:36 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 12:25:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[75347e54-a372-41f4-933b-2cac1202f57a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:25:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:36 devstack sudo[90582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD
Sep 29 12:25:36 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:36 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:36 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Temporary image f8e17489-d113-49d7-ab01-94ac91f04646 is fetched for user 55a705bc1918410fa5540721ffd39ea9. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 12:25:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cdd1b6-63ec-4875-89ca-afe3365f189c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:25:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:37 devstack sudo[90587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD
Sep 29 12:25:37 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:37 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-116185721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce88f127-3a4c-41f2-a500-9fe6cf51c64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5224be9c72747798faac84f2808c23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:25:35Z,use_quota=True,user_id='55a705bc1918410fa5540721ffd39ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Creating volume ce88f127-3a4c-41f2-a500-9fe6cf51c64d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:25:37 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:37 devstack sudo[90592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d 1073741824
Sep 29 12:25:37 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:37 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d 1073741824" returned: 0 in 0.604s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:38 devstack sudo[90618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d
Sep 29 12:25:38 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:38 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d" returned: 0 in 0.277s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:25:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:25:38 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Attempting download of f8e17489-d113-49d7-ab01-94ac91f04646 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}])) to volume ce88f127-3a4c-41f2-a500-9fe6cf51c64d. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 12:25:38 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[379d2119-20b8-41c6-a1fc-1723b29af1c5]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:25:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_dryc_wn2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:38 devstack sudo[90623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_dryc_wn2
Sep 29 12:25:38 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:38 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_dryc_wn2" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_dryc_wn2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:38 devstack sudo[90629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_dryc_wn2
Sep 29 12:25:38 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:39 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_dryc_wn2" returned: 1 in 0.346s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_dryc_wn2' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:25:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6885213-d3fb-43eb-9704-18611e6c6408]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:25:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:39 devstack sudo[90633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD
Sep 29 12:25:39 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:39 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:39 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] f8e17489-d113-49d7-ab01-94ac91f04646 was qcow2, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 12:25:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:39 devstack sudo[90639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d
Sep 29 12:25:39 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:41 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d" returned: 0 in 2.421s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:41 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_0ftav2hfdevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:25:41 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Converted 112.00 MB image at 46.22 MB/s
Sep 29 12:25:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:42 devstack sudo[90664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d 1G
Sep 29 12:25:42 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:42 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d 1G" returned: 0 in 0.452s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:42 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Downloaded image f8e17489-d113-49d7-ab01-94ac91f04646 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}])) to volume ce88f127-3a4c-41f2-a500-9fe6cf51c64d successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 12:25:42 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Temporary image f8e17489-d113-49d7-ab01-94ac91f04646 for user 55a705bc1918410fa5540721ffd39ea9 is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 12:25:42 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Marking volume ce88f127-3a4c-41f2-a500-9fe6cf51c64d as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 12:25:42 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Copying metadata from image f8e17489-d113-49d7-ab01-94ac91f04646 to ce88f127-3a4c-41f2-a500-9fe6cf51c64d. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 12:25:42 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Creating volume glance metadata for volume ce88f127-3a4c-41f2-a500-9fe6cf51c64d backed by image f8e17489-d113-49d7-ab01-94ac91f04646 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 12:25:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f27d583e-5861-483f-ab8d-32a0aa60e47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b7025681d00>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:25:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517c4c11-a851-49a0-a59e-20c596c5b907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:25:42 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Volume volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d (ce88f127-3a4c-41f2-a500-9fe6cf51c64d): created successfully
Sep 29 12:25:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517c4c11-a851-49a0-a59e-20c596c5b907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:25:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Flow 'volume_create_manager' (b93378a5-6dd7-4507-bdd5-1e7d1b6dede7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:25:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-472575f0-a785-4d78-8d24-0f67a06da871 tempest-ServerActionsTestOtherA-114144666 None] Created volume successfully.
Sep 29 12:25:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-469bc816-0d80-4090-81d3-f6e4087695dc req-9a0b02be-8047-4d4a-adab-5a463aeda1b0 tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:25:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-469bc816-0d80-4090-81d3-f6e4087695dc req-9a0b02be-8047-4d4a-adab-5a463aeda1b0 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:25:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-469bc816-0d80-4090-81d3-f6e4087695dc req-9a0b02be-8047-4d4a-adab-5a463aeda1b0 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:25:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-469bc816-0d80-4090-81d3-f6e4087695dc req-9a0b02be-8047-4d4a-adab-5a463aeda1b0 tempest-ServerActionsTestOtherA-114144666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e39ef6b-ff18-4783-ac74-fc9ac5e2f49d', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:25:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-469bc816-0d80-4090-81d3-f6e4087695dc req-9a0b02be-8047-4d4a-adab-5a463aeda1b0 tempest-ServerActionsTestOtherA-114144666 None] attachment_update completed successfully.
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Flow 'volume_create_manager' (83743456-4a8f-4557-aa42-436494aedfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3b2eb4-9c06-4fb1-bab9-0069f45cd93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3b2eb4-9c06-4fb1-bab9-0069f45cd93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1133001727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=102293e3-4ce2-44eb-a2c7-fc9f5baa12cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7358ccf151741178e759b9621c275ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:25:51Z,use_quota=True,user_id='3e39474b4692422ea6ae4d9995ffa3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd9739a-ed29-4ad4-a5da-53f4348e0a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd9739a-ed29-4ad4-a5da-53f4348e0a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91801a5f-7a54-4e5b-9736-c59e74a19e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91801a5f-7a54-4e5b-9736-c59e74a19e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '102293e3-4ce2-44eb-a2c7-fc9f5baa12cc', 'volume_name': 'volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2b7017-04ca-4400-8df8-3b28a40924fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2b7017-04ca-4400-8df8-3b28a40924fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b47053-2ba5-4e1b-9c73-af9b62e239d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:25:51 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Volume 102293e3-4ce2-44eb-a2c7-fc9f5baa12cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc', 'volume_size': 1}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1133001727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=102293e3-4ce2-44eb-a2c7-fc9f5baa12cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7358ccf151741178e759b9621c275ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:25:51Z,use_quota=True,user_id='3e39474b4692422ea6ae4d9995ffa3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Creating volume 102293e3-4ce2-44eb-a2c7-fc9f5baa12cc {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:25:51 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:25:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:51 devstack sudo[90856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc 1073741824
Sep 29 12:25:51 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:52 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc 1073741824" returned: 0 in 1.017s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:25:52 devstack sudo[90879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc
Sep 29 12:25:52 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:25:53 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root
Sep 29 12:25:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc" returned: 0 in 0.613s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:25:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:25:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:25:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b47053-2ba5-4e1b-9c73-af9b62e239d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:25:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b30172-330e-450d-9f00-5256753d6d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:25:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Volume volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc (102293e3-4ce2-44eb-a2c7-fc9f5baa12cc): created successfully
Sep 29 12:25:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b30172-330e-450d-9f00-5256753d6d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:25:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Flow 'volume_create_manager' (83743456-4a8f-4557-aa42-436494aedfbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:25:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-afeaeb73-05e0-4a9b-8a7e-15fb59a9fc96 tempest-AttachVolumeTestJSON-1227494649 None] Created volume successfully.
Sep 29 12:25:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-f2b69300-b3bf-45c6-8e92-199c9627ae28 req-d1dc994f-15d3-4dcb-afcb-aa385c3a797d tempest-TaggedAttachmentsTest-579971402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:25:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-f2b69300-b3bf-45c6-8e92-199c9627ae28 req-d1dc994f-15d3-4dcb-afcb-aa385c3a797d tempest-TaggedAttachmentsTest-579971402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:25:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-f2b69300-b3bf-45c6-8e92-199c9627ae28 req-d1dc994f-15d3-4dcb-afcb-aa385c3a797d tempest-TaggedAttachmentsTest-579971402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:25:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-f2b69300-b3bf-45c6-8e92-199c9627ae28 req-d1dc994f-15d3-4dcb-afcb-aa385c3a797d tempest-TaggedAttachmentsTest-579971402 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-3c152606-8a07-4d49-b706-087d62e79196', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '045e67a7-6005-410d-8acd-6154e62143ca', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:25:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-f2b69300-b3bf-45c6-8e92-199c9627ae28 req-d1dc994f-15d3-4dcb-afcb-aa385c3a797d tempest-TaggedAttachmentsTest-579971402 None] attachment_update completed successfully.
Sep 29 12:25:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-417b5c2a-bea9-4d0a-b0a5-c02151880e1d req-445765c8-5a6e-4b38-b7aa-f2033a7693a9 tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:25:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-417b5c2a-bea9-4d0a-b0a5-c02151880e1d req-445765c8-5a6e-4b38-b7aa-f2033a7693a9 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:25:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-417b5c2a-bea9-4d0a-b0a5-c02151880e1d req-445765c8-5a6e-4b38-b7aa-f2033a7693a9 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:25:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-417b5c2a-bea9-4d0a-b0a5-c02151880e1d req-445765c8-5a6e-4b38-b7aa-f2033a7693a9 tempest-AttachVolumeTestJSON-1227494649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a87afe88-c462-40d5-a71b-d5b383953ca9', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:25:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-417b5c2a-bea9-4d0a-b0a5-c02151880e1d req-445765c8-5a6e-4b38-b7aa-f2033a7693a9 tempest-AttachVolumeTestJSON-1227494649 None] attachment_update completed successfully.
Sep 29 12:25:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-5b62bf73-05dd-4a91-98e7-412a309c5bce req-2c16bc38-b575-40e1-9e86-e46c483d0e81 tempest-TaggedAttachmentsTest-579971402 None] Terminate volume connection completed successfully.
Sep 29 12:25:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-5b62bf73-05dd-4a91-98e7-412a309c5bce req-2c16bc38-b575-40e1-9e86-e46c483d0e81 tempest-TaggedAttachmentsTest-579971402 None] Deleting attachment 045e67a7-6005-410d-8acd-6154e62143ca. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:26:06 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=32,cinder:INSERT=8,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:26:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:26:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:26:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:26:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:26:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:26:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:26:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:26:07 devstack sudo[91602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:26:07 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:26:08 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root
Sep 29 12:26:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.974s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:26:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:26:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:26:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:26:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:26:09 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=13,cinder:SELECT=32,cinder:INSERT=7 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:26:11 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:26:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Flow 'volume_create_manager' (c2006d3e-a136-44a7-bb58-9c8e28e7aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:26:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afb5ba2-d0d0-4949-8a40-e3eb85d9e652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afb5ba2-d0d0-4949-8a40-e3eb85d9e652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2064541999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04150d9-405a-45b6-a130-134c2bd3e66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c36e2c355f54263b63db28354b09208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:26:12Z,use_quota=True,user_id='acbd5bee07924936a666b7b38c295b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf9cecf-be46-4c93-925a-159b3269360e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf9cecf-be46-4c93-925a-159b3269360e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633d153c-65eb-4323-be84-39bf077f4263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633d153c-65eb-4323-be84-39bf077f4263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04150d9-405a-45b6-a130-134c2bd3e66d', 'volume_name': 'volume-f04150d9-405a-45b6-a130-134c2bd3e66d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6fa1cb-654c-4ace-b153-b1c9b34e0861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6fa1cb-654c-4ace-b153-b1c9b34e0861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b9353c-b941-48c5-baaf-f2ce2b6044a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:26:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Volume f04150d9-405a-45b6-a130-134c2bd3e66d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04150d9-405a-45b6-a130-134c2bd3e66d', 'volume_size': 1}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2064541999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04150d9-405a-45b6-a130-134c2bd3e66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c36e2c355f54263b63db28354b09208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:26:12Z,use_quota=True,user_id='acbd5bee07924936a666b7b38c295b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Creating volume f04150d9-405a-45b6-a130-134c2bd3e66d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:26:12 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:26:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f04150d9-405a-45b6-a130-134c2bd3e66d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:26:12 devstack sudo[91650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f04150d9-405a-45b6-a130-134c2bd3e66d 1073741824
Sep 29 12:26:12 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:26:13 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root
Sep 29 12:26:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f04150d9-405a-45b6-a130-134c2bd3e66d 1073741824" returned: 0 in 0.965s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:26:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f04150d9-405a-45b6-a130-134c2bd3e66d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:26:13 devstack sudo[91664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f04150d9-405a-45b6-a130-134c2bd3e66d
Sep 29 12:26:13 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:26:13 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root
Sep 29 12:26:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f04150d9-405a-45b6-a130-134c2bd3e66d" returned: 0 in 0.721s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:26:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:26:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:26:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b9353c-b941-48c5-baaf-f2ce2b6044a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04150d9-405a-45b6-a130-134c2bd3e66d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:26:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51638dbf-d9bf-4d33-a016-785a6757a010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:26:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Volume volume-f04150d9-405a-45b6-a130-134c2bd3e66d (f04150d9-405a-45b6-a130-134c2bd3e66d): created successfully
Sep 29 12:26:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51638dbf-d9bf-4d33-a016-785a6757a010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:26:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Flow 'volume_create_manager' (c2006d3e-a136-44a7-bb58-9c8e28e7aac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:26:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0be54e46-9248-444a-b77b-7669f43c2bb4 tempest-AttachVolumeNegativeTest-1906280415 None] Created volume successfully.
Sep 29 12:26:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-ba07f529-1245-4a09-8bc2-14a92a98128d req-f905ff05-a63e-4611-a777-48d337d8851f tempest-ServerActionsTestOtherA-114144666 None] Terminate volume connection completed successfully.
Sep 29 12:26:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-ba07f529-1245-4a09-8bc2-14a92a98128d req-f905ff05-a63e-4611-a777-48d337d8851f tempest-ServerActionsTestOtherA-114144666 None] Deleting attachment 6e39ef6b-ff18-4783-ac74-fc9ac5e2f49d. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:26:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-850a036a-4da8-4503-aa95-b163fcab70f4 req-93987540-d2ba-446f-81e2-fd1dc312ed01 tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:26:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-850a036a-4da8-4503-aa95-b163fcab70f4 req-93987540-d2ba-446f-81e2-fd1dc312ed01 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:26:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-850a036a-4da8-4503-aa95-b163fcab70f4 req-93987540-d2ba-446f-81e2-fd1dc312ed01 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:26:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-850a036a-4da8-4503-aa95-b163fcab70f4 req-93987540-d2ba-446f-81e2-fd1dc312ed01 tempest-AttachVolumeNegativeTest-1906280415 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-f04150d9-405a-45b6-a130-134c2bd3e66d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02e08bfe-f9ad-4baa-bac2-352005a56794', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:26:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-850a036a-4da8-4503-aa95-b163fcab70f4 req-93987540-d2ba-446f-81e2-fd1dc312ed01 tempest-AttachVolumeNegativeTest-1906280415 None] attachment_update completed successfully.
Sep 29 12:26:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-ba07f529-1245-4a09-8bc2-14a92a98128d req-89839db2-f54d-49e8-92ed-7053323afe86 tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:26:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-ba07f529-1245-4a09-8bc2-14a92a98128d req-89839db2-f54d-49e8-92ed-7053323afe86 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:26:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-ba07f529-1245-4a09-8bc2-14a92a98128d req-89839db2-f54d-49e8-92ed-7053323afe86 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:26:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-ba07f529-1245-4a09-8bc2-14a92a98128d req-89839db2-f54d-49e8-92ed-7053323afe86 tempest-ServerActionsTestOtherA-114144666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb0d5537-226e-4a8f-a947-46d43323ae2c', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:26:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-ba07f529-1245-4a09-8bc2-14a92a98128d req-89839db2-f54d-49e8-92ed-7053323afe86 tempest-ServerActionsTestOtherA-114144666 None] attachment_update completed successfully.
Sep 29 12:26:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Acquiring lock "cinder-3c152606-8a07-4d49-b706-087d62e79196-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:26:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Lock "cinder-3c152606-8a07-4d49-b706-087d62e79196-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:26:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Acquiring lock "cinder-quobyte-3c152606-8a07-4d49-b706-087d62e79196" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:26:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Lock "cinder-quobyte-3c152606-8a07-4d49-b706-087d62e79196" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:26:22 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0e4652-b969-4f99-a922-600d5aeb842c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:26:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3c152606-8a07-4d49-b706-087d62e79196 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:26:22 devstack sudo[91813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3c152606-8a07-4d49-b706-087d62e79196
Sep 29 12:26:22 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:26:23 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root
Sep 29 12:26:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3c152606-8a07-4d49-b706-087d62e79196" returned: 0 in 0.571s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:26:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3c152606-8a07-4d49-b706-087d62e79196 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:26:23 devstack sudo[91825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3c152606-8a07-4d49-b706-087d62e79196
Sep 29 12:26:23 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:26:23 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root
Sep 29 12:26:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3c152606-8a07-4d49-b706-087d62e79196" returned: 0 in 0.389s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:26:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Lock "cinder-quobyte-3c152606-8a07-4d49-b706-087d62e79196" released by "delete_volume" :: held 1.032s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:26:23 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Created reservations ['67925db1-106c-46fa-8a60-c8db95e1df9b', 'ecd24a4e-42f6-4096-ab01-d61a2d499567', '28d9bd93-6182-40c2-b776-c5ba451b0d02', '779489f7-9438-46f7-a722-b27ea1c8f47b'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:26:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:26:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:26:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:26:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:26:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:26:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:26:23 devstack sudo[91833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:26:23 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:26:24 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root
Sep 29 12:26:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.553s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:26:24 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:26:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Deleted volume successfully.
Sep 29 12:26:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8def5d07-3cb9-4e02-80a5-a0aa7891bdf2 tempest-TaggedAttachmentsTest-579971402 None] Lock "cinder-3c152606-8a07-4d49-b706-087d62e79196-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:26:33 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=21,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:26:34 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=19,cinder:SELECT=22,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:26:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-68eeadc2-21ac-4e3d-b054-25e03ae7d784 req-86da8a58-4793-4c4c-9da6-c4e0b94ac1d6 tempest-AttachVolumeTestJSON-1227494649 None] Terminate volume connection completed successfully.
Sep 29 12:26:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-68eeadc2-21ac-4e3d-b054-25e03ae7d784 req-86da8a58-4793-4c4c-9da6-c4e0b94ac1d6 tempest-AttachVolumeTestJSON-1227494649 None] Deleting attachment a87afe88-c462-40d5-a71b-d5b383953ca9. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:26:58 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:26:58 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:27:00 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-c59fb4ee-96d1-4d31-a836-ab50f490b616 tempest-ServerActionsTestOtherA-114144666 None] Terminate volume connection completed successfully.
Sep 29 12:27:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-c59fb4ee-96d1-4d31-a836-ab50f490b616 tempest-ServerActionsTestOtherA-114144666 None] Deleting attachment fb0d5537-226e-4a8f-a947-46d43323ae2c. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:27:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "cinder-ce88f127-3a4c-41f2-a500-9fe6cf51c64d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:27:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Lock "cinder-ce88f127-3a4c-41f2-a500-9fe6cf51c64d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:27:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "cinder-quobyte-ce88f127-3a4c-41f2-a500-9fe6cf51c64d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:27:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Lock "cinder-quobyte-ce88f127-3a4c-41f2-a500-9fe6cf51c64d" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:27:01 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f4fc96-9af1-48ce-80bb-46bea27cf1a3]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:27:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:01 devstack sudo[92246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d
Sep 29 12:27:01 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:01 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d" returned: 0 in 0.570s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:01 devstack sudo[92254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d
Sep 29 12:27:01 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:02 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce88f127-3a4c-41f2-a500-9fe6cf51c64d" returned: 0 in 0.523s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Lock "cinder-quobyte-ce88f127-3a4c-41f2-a500-9fe6cf51c64d" released by "delete_volume" :: held 1.212s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:27:02 devstack cinder-volume[86369]: DEBUG cinder.quota [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Created reservations ['9a99e4da-a583-4baf-a1fd-c9141b053fb4', '5940e385-749f-4836-ae69-c1b6cc23422b', 'f98817e5-4a27-4062-bed6-54296093fe68', '143f6959-b8e7-49eb-bccf-5e43f01c893c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:27:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:27:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:27:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:27:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:27:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:27:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:02 devstack sudo[92257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:27:02 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:03 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:03 devstack cinder-volume[86369]: DEBUG cinder.manager [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:27:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Deleted volume successfully.
Sep 29 12:27:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-3aa52d98-3dcd-4887-b620-9c5dc8ee9486 req-95ff1d2b-157a-4664-b6e2-88c695144bf7 tempest-ServerActionsTestOtherA-114144666 None] Lock "cinder-ce88f127-3a4c-41f2-a500-9fe6cf51c64d-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:27:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "cinder-f7ebda30-86e7-4296-a28e-25b53c9645de-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:27:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Lock "cinder-f7ebda30-86e7-4296-a28e-25b53c9645de-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:27:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "cinder-quobyte-f7ebda30-86e7-4296-a28e-25b53c9645de" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:27:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Lock "cinder-quobyte-f7ebda30-86e7-4296-a28e-25b53c9645de" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:27:04 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4f553d-a8ee-4ec3-9c91-3d166cb11b74]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:27:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7ebda30-86e7-4296-a28e-25b53c9645de {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:04 devstack sudo[92262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7ebda30-86e7-4296-a28e-25b53c9645de
Sep 29 12:27:04 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:04 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7ebda30-86e7-4296-a28e-25b53c9645de" returned: 0 in 0.637s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7ebda30-86e7-4296-a28e-25b53c9645de {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:04 devstack sudo[92268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7ebda30-86e7-4296-a28e-25b53c9645de
Sep 29 12:27:04 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:05 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7ebda30-86e7-4296-a28e-25b53c9645de" returned: 0 in 0.490s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Lock "cinder-quobyte-f7ebda30-86e7-4296-a28e-25b53c9645de" released by "delete_volume" :: held 1.228s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:27:05 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Created reservations ['72149b57-909f-4f48-bc54-5736fae788d6', 'af95c471-6aa1-41d0-a3f3-fa6990765756', 'b281d77a-2d8f-4832-b8c3-97c63c4a872b', 'f8b289b3-234a-4282-ab98-e66782e9fc66'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:27:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:27:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:27:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:27:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:27:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:27:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:05 devstack sudo[92288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:27:05 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:06 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.805s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:06 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:27:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Deleted volume successfully.
Sep 29 12:27:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a24f1744-46d8-47ae-9531-7314540db31d tempest-ServerActionsTestOtherA-114144666 None] Lock "cinder-f7ebda30-86e7-4296-a28e-25b53c9645de-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:27:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:27:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:27:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:27:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:27:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:27:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:27:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:07 devstack sudo[92352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:27:07 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-3fc77422-5090-4150-b19d-67d6be868dc0 req-23edcee1-9e65-4fa3-8ca8-5c5d11e1d85b tempest-AttachVolumeNegativeTest-1906280415 None] Terminate volume connection completed successfully.
Sep 29 12:27:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-3fc77422-5090-4150-b19d-67d6be868dc0 req-23edcee1-9e65-4fa3-8ca8-5c5d11e1d85b tempest-AttachVolumeNegativeTest-1906280415 None] Deleting attachment 02e08bfe-f9ad-4baa-bac2-352005a56794. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:27:08 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 1.005s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:27:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:27:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:27:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:27:17 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:INSERT=5 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:27:17 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:27:29 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:27:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Flow 'volume_create_manager' (54c262c8-9a04-4f92-af64-0dd34732addf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:27:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0180320d-5605-45e0-8faa-16159de02ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0180320d-5605-45e0-8faa-16159de02ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-483653141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a14d86-1466-48e1-a4aa-abfe5efd87a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5369fcb5549546eaad4c57b61644a582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:27:30Z,use_quota=True,user_id='98c88fb6163d4a0986454789098278d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e228941-ca48-4805-a6ad-fb0294496cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e228941-ca48-4805-a6ad-fb0294496cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ab35b9-f794-47e0-98e0-a481293ec1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ab35b9-f794-47e0-98e0-a481293ec1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a14d86-1466-48e1-a4aa-abfe5efd87a0', 'volume_name': 'volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a960548c-ff0e-435b-aae8-16abecea8879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a960548c-ff0e-435b-aae8-16abecea8879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9f9988-8bd0-4f4f-84ec-68a9f7acdae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:27:30 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Volume 89a14d86-1466-48e1-a4aa-abfe5efd87a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0', 'volume_size': 1}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-483653141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a14d86-1466-48e1-a4aa-abfe5efd87a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5369fcb5549546eaad4c57b61644a582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:27:30Z,use_quota=True,user_id='98c88fb6163d4a0986454789098278d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Creating volume 89a14d86-1466-48e1-a4aa-abfe5efd87a0 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:27:30 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:30 devstack sudo[92645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0 1073741824
Sep 29 12:27:30 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Flow 'volume_create_manager' (95399ed4-ee57-4d94-b072-70b46555ead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (168c0150-e827-468f-b306-865344054633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (168c0150-e827-468f-b306-865344054633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-381689874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9af58e-6ddf-4111-965f-cedefb703323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833c1cdba12648eca2d8eecf49ad0181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:27:30Z,use_quota=True,user_id='22c717dbf6f64b3c8ab2264b0c20b140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93e1895-ee1d-4331-856b-f2bf1a407167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93e1895-ee1d-4331-856b-f2bf1a407167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc04edb-e2d5-4211-b52e-68625adb5430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc04edb-e2d5-4211-b52e-68625adb5430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c9af58e-6ddf-4111-965f-cedefb703323', 'volume_name': 'volume-7c9af58e-6ddf-4111-965f-cedefb703323', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0202be7c-72c2-414d-9006-bbadbf228b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0202be7c-72c2-414d-9006-bbadbf228b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e36157-2ac3-4836-b1e6-15deba99ba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:27:30 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Volume 7c9af58e-6ddf-4111-965f-cedefb703323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c9af58e-6ddf-4111-965f-cedefb703323', 'volume_size': 1}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:27:30 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0 1073741824" returned: 0 in 0.770s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:30 devstack sudo[92651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0
Sep 29 12:27:30 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:31 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0" returned: 0 in 0.389s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.070s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-381689874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9af58e-6ddf-4111-965f-cedefb703323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833c1cdba12648eca2d8eecf49ad0181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:27:30Z,use_quota=True,user_id='22c717dbf6f64b3c8ab2264b0c20b140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Creating volume 7c9af58e-6ddf-4111-965f-cedefb703323 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:27:31 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c9af58e-6ddf-4111-965f-cedefb703323 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:31 devstack sudo[92654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c9af58e-6ddf-4111-965f-cedefb703323 1073741824
Sep 29 12:27:31 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9f9988-8bd0-4f4f-84ec-68a9f7acdae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b68c39a-09d6-4dc0-b362-e166565be80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:27:31 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Volume volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0 (89a14d86-1466-48e1-a4aa-abfe5efd87a0): created successfully
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b68c39a-09d6-4dc0-b362-e166565be80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:27:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Flow 'volume_create_manager' (54c262c8-9a04-4f92-af64-0dd34732addf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:27:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-93a0999e-9e25-4c46-bee1-60bee249fcdd req-d3c6a920-8a04-4d41-be0f-cbadeacdee96 tempest-VolumesGetTestJSON-1022069273 None] Created volume successfully.
Sep 29 12:27:32 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c9af58e-6ddf-4111-965f-cedefb703323 1073741824" returned: 0 in 0.735s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c9af58e-6ddf-4111-965f-cedefb703323 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:32 devstack sudo[92661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c9af58e-6ddf-4111-965f-cedefb703323
Sep 29 12:27:32 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Acquiring lock "cinder-89a14d86-1466-48e1-a4aa-abfe5efd87a0-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:27:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Lock "cinder-89a14d86-1466-48e1-a4aa-abfe5efd87a0-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Acquiring lock "cinder-quobyte-89a14d86-1466-48e1-a4aa-abfe5efd87a0" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:27:33 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c9af58e-6ddf-4111-965f-cedefb703323" returned: 0 in 0.843s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Lock "cinder-quobyte-89a14d86-1466-48e1-a4aa-abfe5efd87a0" acquired by "delete_volume" :: waited 0.052s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e36157-2ac3-4836-b1e6-15deba99ba5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9af58e-6ddf-4111-965f-cedefb703323', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954efb9b-2523-453a-9ce5-795f6327cb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f164fdeb-fb8f-44db-b90f-835befdd1124]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Volume volume-7c9af58e-6ddf-4111-965f-cedefb703323 (7c9af58e-6ddf-4111-965f-cedefb703323): created successfully
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954efb9b-2523-453a-9ce5-795f6327cb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Flow 'volume_create_manager' (95399ed4-ee57-4d94-b072-70b46555ead4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:27:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-66cf2e63-9fd6-4b8b-9cd0-b605f053c070 tempest-ServerRescueNegativeTestJSON-815234371 None] Created volume successfully.
Sep 29 12:27:33 devstack sudo[92665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0
Sep 29 12:27:33 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:33 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0" returned: 0 in 0.729s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:33 devstack sudo[92671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0
Sep 29 12:27:33 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:34 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-89a14d86-1466-48e1-a4aa-abfe5efd87a0" returned: 0 in 0.516s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Lock "cinder-quobyte-89a14d86-1466-48e1-a4aa-abfe5efd87a0" released by "delete_volume" :: held 1.386s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:27:34 devstack cinder-volume[86369]: DEBUG cinder.quota [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Created reservations ['887e52f6-69bd-47c8-b1e4-511c9509a499', 'ddacdcda-8c8b-4839-b4da-4d5680792260', 'd6aa2065-0136-425a-acfb-0b4b7e496f42', '87beea8d-bd5e-4cd5-9068-f425742cd8c9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:27:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:27:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:27:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:27:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:27:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:27:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:34 devstack sudo[92706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:27:34 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:35 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.759s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:35 devstack cinder-volume[86369]: DEBUG cinder.manager [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:27:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Deleted volume successfully.
Sep 29 12:27:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-408e8d7b-1b73-42aa-a9bb-f30edbec27b6 req-3d39c2d3-1009-4d67-b32c-40d3a41a9d9b tempest-VolumesGetTestJSON-1022069273 None] Lock "cinder-89a14d86-1466-48e1-a4aa-abfe5efd87a0-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:27:44 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=21,cinder:SELECT=7,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:27:45 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=11,cinder:UPDATE=7,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:27:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3391e6df-cfa0-439f-b53d-e7ec5a5c6354 tempest-GroupsV320Test-879162398 None] Group tempest-GroupsV320Test-Group-614742604: creating
Sep 29 12:27:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3391e6df-cfa0-439f-b53d-e7ec5a5c6354 tempest-GroupsV320Test-879162398 None] Group tempest-GroupsV320Test-Group-614742604: created successfully
Sep 29 12:27:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3391e6df-cfa0-439f-b53d-e7ec5a5c6354 tempest-GroupsV320Test-879162398 None] Create group completed successfully.
Sep 29 12:27:50 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-56729ce0-8d1b-4ca9-bd9e-d4dccd77352e tempest-GroupsV320Test-879162398 None] Created reservations ['7f5edbf6-0a85-44db-805b-9faa9e14d32c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:27:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-56729ce0-8d1b-4ca9-bd9e-d4dccd77352e tempest-GroupsV320Test-879162398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:27:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-56729ce0-8d1b-4ca9-bd9e-d4dccd77352e tempest-GroupsV320Test-879162398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:27:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-56729ce0-8d1b-4ca9-bd9e-d4dccd77352e tempest-GroupsV320Test-879162398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:27:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-56729ce0-8d1b-4ca9-bd9e-d4dccd77352e tempest-GroupsV320Test-879162398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:27:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-56729ce0-8d1b-4ca9-bd9e-d4dccd77352e tempest-GroupsV320Test-879162398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:27:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-56729ce0-8d1b-4ca9-bd9e-d4dccd77352e tempest-GroupsV320Test-879162398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:51 devstack sudo[92984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:27:51 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:51 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-56729ce0-8d1b-4ca9-bd9e-d4dccd77352e tempest-GroupsV320Test-879162398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.356s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:51 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-56729ce0-8d1b-4ca9-bd9e-d4dccd77352e tempest-GroupsV320Test-879162398 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:27:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-56729ce0-8d1b-4ca9-bd9e-d4dccd77352e tempest-GroupsV320Test-879162398 None] Delete group completed successfully.
Sep 29 12:27:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Acquiring lock "cinder-7c9af58e-6ddf-4111-965f-cedefb703323-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:27:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Lock "cinder-7c9af58e-6ddf-4111-965f-cedefb703323-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:27:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Acquiring lock "cinder-quobyte-7c9af58e-6ddf-4111-965f-cedefb703323" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:27:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Lock "cinder-quobyte-7c9af58e-6ddf-4111-965f-cedefb703323" acquired by "delete_volume" :: waited 0.044s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:27:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e022b051-9d25-4a8e-8301-0b57ea81b26d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:27:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c9af58e-6ddf-4111-965f-cedefb703323 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:56 devstack sudo[93071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c9af58e-6ddf-4111-965f-cedefb703323
Sep 29 12:27:56 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:56 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c9af58e-6ddf-4111-965f-cedefb703323" returned: 0 in 0.840s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c9af58e-6ddf-4111-965f-cedefb703323 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:56 devstack sudo[93077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c9af58e-6ddf-4111-965f-cedefb703323
Sep 29 12:27:56 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:57 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c9af58e-6ddf-4111-965f-cedefb703323" returned: 0 in 0.603s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Lock "cinder-quobyte-7c9af58e-6ddf-4111-965f-cedefb703323" released by "delete_volume" :: held 1.580s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:27:57 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Created reservations ['769659f5-8918-4aeb-88c5-4d0d0a93e389', '69238dc7-3ce5-4658-a66c-66da238ae76f', '77521af6-b9e0-4390-ab03-df4d3c12cfe5', 'ae578ea5-be89-4448-82c9-67f0f4070a58'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:27:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:27:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:27:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:27:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:27:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:27:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:27:57 devstack sudo[93081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:27:57 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:27:57 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root
Sep 29 12:27:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.462s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:27:57 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:27:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Deleted volume successfully.
Sep 29 12:27:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e1b6a99e-f1ba-4da9-8b01-c97e9a75d9c6 tempest-ServerRescueNegativeTestJSON-815234371 None] Lock "cinder-7c9af58e-6ddf-4111-965f-cedefb703323-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:28:03 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:28:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Flow 'volume_create_manager' (d4bfbd82-a60d-4d9b-b76c-15abdc895596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:28:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd22e57-a479-4638-8374-917593b7f66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd22e57-a479-4638-8374-917593b7f66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1723809527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27ec9eb-b413-461f-b76b-e5dcc50fcc96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c36e2c355f54263b63db28354b09208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:28:04Z,use_quota=True,user_id='acbd5bee07924936a666b7b38c295b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fdcc17-d6c0-4b48-bf30-a087dcb48cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fdcc17-d6c0-4b48-bf30-a087dcb48cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d828f80e-41b7-47e6-b8e8-2053f6865a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d828f80e-41b7-47e6-b8e8-2053f6865a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27ec9eb-b413-461f-b76b-e5dcc50fcc96', 'volume_name': 'volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6f2cab-baf2-4f79-a338-28057be2bdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6f2cab-baf2-4f79-a338-28057be2bdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e8567d-7fe6-45ad-be4f-ad0107cc7980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Volume e27ec9eb-b413-461f-b76b-e5dcc50fcc96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96', 'volume_size': 1}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1723809527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27ec9eb-b413-461f-b76b-e5dcc50fcc96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c36e2c355f54263b63db28354b09208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:28:04Z,use_quota=True,user_id='acbd5bee07924936a666b7b38c295b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Creating volume e27ec9eb-b413-461f-b76b-e5dcc50fcc96 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:28:04 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:04 devstack sudo[93124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96 1073741824
Sep 29 12:28:04 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:04 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96 1073741824" returned: 0 in 0.727s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:04 devstack sudo[93150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96
Sep 29 12:28:04 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:05 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96" returned: 0 in 0.756s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:28:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e8567d-7fe6-45ad-be4f-ad0107cc7980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97dca1d-7680-4a29-94df-e9190d5d1c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Volume volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96 (e27ec9eb-b413-461f-b76b-e5dcc50fcc96): created successfully
Sep 29 12:28:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97dca1d-7680-4a29-94df-e9190d5d1c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Flow 'volume_create_manager' (d4bfbd82-a60d-4d9b-b76c-15abdc895596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:28:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5e558e50-e72c-46d5-ba0f-bd1ed2773214 tempest-AttachVolumeNegativeTest-1906280415 None] Created volume successfully.
Sep 29 12:28:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-22c8be65-f396-4915-9010-0d998e0971e7 req-7183634c-2d30-4eab-9548-618b5ffc64e6 tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-22c8be65-f396-4915-9010-0d998e0971e7 req-7183634c-2d30-4eab-9548-618b5ffc64e6 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-22c8be65-f396-4915-9010-0d998e0971e7 req-7183634c-2d30-4eab-9548-618b5ffc64e6 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-22c8be65-f396-4915-9010-0d998e0971e7 req-7183634c-2d30-4eab-9548-618b5ffc64e6 tempest-AttachVolumeNegativeTest-1906280415 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0792a118-418e-4826-8252-8dc1aa119603', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:28:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-22c8be65-f396-4915-9010-0d998e0971e7 req-7183634c-2d30-4eab-9548-618b5ffc64e6 tempest-AttachVolumeNegativeTest-1906280415 None] attachment_update completed successfully.
Sep 29 12:28:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:28:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:07 devstack sudo[93588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:28:07 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:08 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.614s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:28:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:28:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:28:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:28:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-a80c3dec-3451-4e57-9880-921959d3ba75 req-37a074cd-6441-4852-b34a-a05d6a9406a6 tempest-AttachVolumeNegativeTest-1906280415 None] Terminate volume connection completed successfully.
Sep 29 12:28:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-a80c3dec-3451-4e57-9880-921959d3ba75 req-37a074cd-6441-4852-b34a-a05d6a9406a6 tempest-AttachVolumeNegativeTest-1906280415 None] Deleting attachment 0792a118-418e-4826-8252-8dc1aa119603. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Flow 'volume_create_manager' (2f12ceeb-f8a1-463f-8e87-93425ff878d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c4a4ae-a08b-4b1e-b0cf-c02f734708eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c4a4ae-a08b-4b1e-b0cf-c02f734708eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-164777427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a021aaa-6bc0-49ed-a3eb-8dc2f665affd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7358ccf151741178e759b9621c275ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:28:20Z,use_quota=True,user_id='3e39474b4692422ea6ae4d9995ffa3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754b8841-3992-4e64-aacc-212f3bdfec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754b8841-3992-4e64-aacc-212f3bdfec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf95acd8-8012-45f5-946a-a3fe64089157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf95acd8-8012-45f5-946a-a3fe64089157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a021aaa-6bc0-49ed-a3eb-8dc2f665affd', 'volume_name': 'volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4839766e-aff5-4444-aaa9-e880797f88d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4839766e-aff5-4444-aaa9-e880797f88d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb3d845-9be8-4f4a-9cea-0f2c55a126e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Volume 3a021aaa-6bc0-49ed-a3eb-8dc2f665affd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd', 'volume_size': 1}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-164777427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a021aaa-6bc0-49ed-a3eb-8dc2f665affd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7358ccf151741178e759b9621c275ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:28:20Z,use_quota=True,user_id='3e39474b4692422ea6ae4d9995ffa3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Creating volume 3a021aaa-6bc0-49ed-a3eb-8dc2f665affd {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:28:19 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:28:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:19 devstack sudo[93684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd 1073741824
Sep 29 12:28:19 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:20 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd 1073741824" returned: 0 in 0.588s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:20 devstack sudo[93693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd
Sep 29 12:28:20 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:20 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd" returned: 0 in 0.368s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:28:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb3d845-9be8-4f4a-9cea-0f2c55a126e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f82d4e-89c5-4a5b-a895-243dee26c598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Volume volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd (3a021aaa-6bc0-49ed-a3eb-8dc2f665affd): created successfully
Sep 29 12:28:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f82d4e-89c5-4a5b-a895-243dee26c598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Flow 'volume_create_manager' (2f12ceeb-f8a1-463f-8e87-93425ff878d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:28:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a81d41e7-dfa3-45dd-8801-8bb2e4f73ad3 tempest-AttachVolumeTestJSON-1227494649 None] Created volume successfully.
Sep 29 12:28:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-75521474-a1ff-4669-a641-747322b4c438 req-9c4ef39b-1cfa-4f34-a8f6-99daee22597d tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-75521474-a1ff-4669-a641-747322b4c438 req-9c4ef39b-1cfa-4f34-a8f6-99daee22597d tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-75521474-a1ff-4669-a641-747322b4c438 req-9c4ef39b-1cfa-4f34-a8f6-99daee22597d tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-75521474-a1ff-4669-a641-747322b4c438 req-9c4ef39b-1cfa-4f34-a8f6-99daee22597d tempest-AttachVolumeTestJSON-1227494649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc8b34af-a787-4f7f-941c-959eb86f6390', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:28:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-75521474-a1ff-4669-a641-747322b4c438 req-9c4ef39b-1cfa-4f34-a8f6-99daee22597d tempest-AttachVolumeTestJSON-1227494649 None] attachment_update completed successfully.
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Flow 'volume_create_manager' (61531cfc-11f4-4247-8886-11200da5a661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2b01a8-dfe0-4065-8975-9bcee0221b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2b01a8-dfe0-4065-8975-9bcee0221b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-410309987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc576226-4633-459a-88b5-807148e11abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d0ca23501745a789e99e4731aef14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:28:25Z,use_quota=True,user_id='fd3b4cb82f7949369c8fc6c2a2d7f632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85dfbfba-8272-4fec-889a-24bab27be3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85dfbfba-8272-4fec-889a-24bab27be3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de03c8f7-e408-42ef-90b7-542df49a5b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de03c8f7-e408-42ef-90b7-542df49a5b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc576226-4633-459a-88b5-807148e11abb', 'volume_name': 'volume-cc576226-4633-459a-88b5-807148e11abb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf85fd3-f65f-455f-8c8d-2435ace30b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf85fd3-f65f-455f-8c8d-2435ace30b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59109869-0614-4161-82ee-9236719d9a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Volume cc576226-4633-459a-88b5-807148e11abb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc576226-4633-459a-88b5-807148e11abb', 'volume_size': 1}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-410309987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc576226-4633-459a-88b5-807148e11abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d0ca23501745a789e99e4731aef14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:28:25Z,use_quota=True,user_id='fd3b4cb82f7949369c8fc6c2a2d7f632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Creating volume cc576226-4633-459a-88b5-807148e11abb {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:28:25 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:28:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc576226-4633-459a-88b5-807148e11abb 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:25 devstack sudo[94148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc576226-4633-459a-88b5-807148e11abb 1073741824
Sep 29 12:28:25 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:26 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc576226-4633-459a-88b5-807148e11abb 1073741824" returned: 0 in 0.775s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc576226-4633-459a-88b5-807148e11abb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:28:26 devstack sudo[94155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc576226-4633-459a-88b5-807148e11abb
Sep 29 12:28:26 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Flow 'volume_create_manager' (6bd0a11b-7b61-4d40-876b-b0e1e33a04b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00621de3-02a5-491e-ae75-f80b470b2238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00621de3-02a5-491e-ae75-f80b470b2238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1016767085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02781ba-9d01-4748-9046-fa9d5691f75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7358ccf151741178e759b9621c275ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:28:26Z,use_quota=True,user_id='3e39474b4692422ea6ae4d9995ffa3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44cf792-e94f-40e7-80df-8ced2749748a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44cf792-e94f-40e7-80df-8ced2749748a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445eab4a-ba3f-4dde-852e-919c6c15dd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445eab4a-ba3f-4dde-852e-919c6c15dd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e02781ba-9d01-4748-9046-fa9d5691f75c', 'volume_name': 'volume-e02781ba-9d01-4748-9046-fa9d5691f75c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea9cf03-aaa5-472b-af08-3cd265e162ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea9cf03-aaa5-472b-af08-3cd265e162ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576fc395-6b02-44bc-8c14-4f8c36c1142c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Volume e02781ba-9d01-4748-9046-fa9d5691f75c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e02781ba-9d01-4748-9046-fa9d5691f75c', 'volume_size': 1}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:26 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc576226-4633-459a-88b5-807148e11abb" returned: 0 in 0.396s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.234s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1016767085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02781ba-9d01-4748-9046-fa9d5691f75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7358ccf151741178e759b9621c275ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:28:26Z,use_quota=True,user_id='3e39474b4692422ea6ae4d9995ffa3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Creating volume e02781ba-9d01-4748-9046-fa9d5691f75c {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:28:26 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e02781ba-9d01-4748-9046-fa9d5691f75c 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59109869-0614-4161-82ee-9236719d9a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc576226-4633-459a-88b5-807148e11abb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bebdf6-16e7-4bd1-bc76-02f993e0bbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:26 devstack sudo[94158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e02781ba-9d01-4748-9046-fa9d5691f75c 1073741824
Sep 29 12:28:26 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Volume volume-cc576226-4633-459a-88b5-807148e11abb (cc576226-4633-459a-88b5-807148e11abb): created successfully
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bebdf6-16e7-4bd1-bc76-02f993e0bbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Flow 'volume_create_manager' (61531cfc-11f4-4247-8886-11200da5a661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:28:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5f6905b0-3656-49b6-9d48-49ea2372875d tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Created volume successfully.
Sep 29 12:28:27 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e02781ba-9d01-4748-9046-fa9d5691f75c 1073741824" returned: 0 in 1.033s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e02781ba-9d01-4748-9046-fa9d5691f75c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:27 devstack sudo[94210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e02781ba-9d01-4748-9046-fa9d5691f75c
Sep 29 12:28:27 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:28 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e02781ba-9d01-4748-9046-fa9d5691f75c" returned: 0 in 0.706s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:28:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576fc395-6b02-44bc-8c14-4f8c36c1142c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02781ba-9d01-4748-9046-fa9d5691f75c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9942cf-1a43-4828-95f1-cc0b9896cc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:28 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Volume volume-e02781ba-9d01-4748-9046-fa9d5691f75c (e02781ba-9d01-4748-9046-fa9d5691f75c): created successfully
Sep 29 12:28:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9942cf-1a43-4828-95f1-cc0b9896cc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Flow 'volume_create_manager' (6bd0a11b-7b61-4d40-876b-b0e1e33a04b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:28:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5eed95a9-6cb6-468d-bab2-140acb66debe tempest-AttachVolumeTestJSON-1227494649 None] Created volume successfully.
Sep 29 12:28:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Acquiring lock "cinder-cc576226-4633-459a-88b5-807148e11abb-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:28:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Lock "cinder-cc576226-4633-459a-88b5-807148e11abb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:28:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Acquiring lock "cinder-quobyte-cc576226-4633-459a-88b5-807148e11abb" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:28:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Lock "cinder-quobyte-cc576226-4633-459a-88b5-807148e11abb" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:28:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbee42c8-df4d-4cf0-a168-562ffa3fa1e9]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:28:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc576226-4633-459a-88b5-807148e11abb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:29 devstack sudo[94250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc576226-4633-459a-88b5-807148e11abb
Sep 29 12:28:29 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:30 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc576226-4633-459a-88b5-807148e11abb" returned: 0 in 0.741s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc576226-4633-459a-88b5-807148e11abb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:30 devstack sudo[94262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc576226-4633-459a-88b5-807148e11abb
Sep 29 12:28:30 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:30 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc576226-4633-459a-88b5-807148e11abb" returned: 0 in 0.535s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Lock "cinder-quobyte-cc576226-4633-459a-88b5-807148e11abb" released by "delete_volume" :: held 1.359s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:28:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Created reservations ['7ef4fd24-86f7-40d6-ad88-0fb180148428', '5022e13c-096e-411a-b7e4-0c0007129357', '0c0b93e4-806d-44be-898d-c47446fbb7dd', 'a6998d01-c702-495a-ad2e-11d357e69138'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-f0211173-f605-4065-b517-2315147fba04 req-52f5daeb-6cf1-4495-bf27-9a0381161b54 tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-f0211173-f605-4065-b517-2315147fba04 req-52f5daeb-6cf1-4495-bf27-9a0381161b54 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:31 devstack sudo[94273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:28:31 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-f0211173-f605-4065-b517-2315147fba04 req-52f5daeb-6cf1-4495-bf27-9a0381161b54 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-f0211173-f605-4065-b517-2315147fba04 req-52f5daeb-6cf1-4495-bf27-9a0381161b54 tempest-AttachVolumeTestJSON-1227494649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-e02781ba-9d01-4748-9046-fa9d5691f75c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '128e554a-5dbd-4aa5-a63b-b4ae5cf4f24d', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:28:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-f0211173-f605-4065-b517-2315147fba04 req-52f5daeb-6cf1-4495-bf27-9a0381161b54 tempest-AttachVolumeTestJSON-1227494649 None] attachment_update completed successfully.
Sep 29 12:28:31 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.649s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:28:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Deleted volume successfully.
Sep 29 12:28:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6210f447-e86e-4f77-9428-ee3bc5e8c7b7 tempest-VolumeQuotasNegativeTestJSON-1428811656 None] Lock "cinder-cc576226-4633-459a-88b5-807148e11abb-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:28:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-0518869d-071d-463e-88ee-08a2d8c7115e req-d14efabd-04c3-4e04-8bd0-e9d9314cab2a tempest-AttachVolumeTestJSON-1227494649 None] Terminate volume connection completed successfully.
Sep 29 12:28:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0518869d-071d-463e-88ee-08a2d8c7115e req-d14efabd-04c3-4e04-8bd0-e9d9314cab2a tempest-AttachVolumeTestJSON-1227494649 None] Deleting attachment fc8b34af-a787-4f7f-941c-959eb86f6390. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:28:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-57af02ef-7d7e-452c-845e-c2ef3b5c182c req-3f12f834-c0f7-4b41-b5ce-2b1de783616d tempest-AttachVolumeTestJSON-1227494649 None] Terminate volume connection completed successfully.
Sep 29 12:28:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-57af02ef-7d7e-452c-845e-c2ef3b5c182c req-3f12f834-c0f7-4b41-b5ce-2b1de783616d tempest-AttachVolumeTestJSON-1227494649 None] Deleting attachment 128e554a-5dbd-4aa5-a63b-b4ae5cf4f24d. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Flow 'volume_create_manager' (ace5b34c-3d0a-41d5-931c-20c0d6016554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e9948c-2fe7-49bb-a76a-685eafaa333c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e9948c-2fe7-49bb-a76a-685eafaa333c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-15993646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6196cb98b6eb455e998b33b0f582bc70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:28:43Z,use_quota=True,user_id='48b7b370bee04c62b542466415e06b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86f3789d-733b-4f3f-b7a1-b580c5ac106b),volume_type_id=86f3789d-733b-4f3f-b7a1-b580c5ac106b)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f4dbf7-b7ed-4541-94bc-ecc1100b7574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f4dbf7-b7ed-4541-94bc-ecc1100b7574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448b25f5-1abe-41ab-8a26-e8fd6ca06692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448b25f5-1abe-41ab-8a26-e8fd6ca06692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6', 'volume_name': 'volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0002ae3c-c134-4717-ac30-cfdd2fe69690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0002ae3c-c134-4717-ac30-cfdd2fe69690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458038b9-ff08-4d17-a7da-12a56a287c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:43 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Volume 3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6', 'volume_size': 1}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-15993646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6196cb98b6eb455e998b33b0f582bc70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:28:43Z,use_quota=True,user_id='48b7b370bee04c62b542466415e06b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86f3789d-733b-4f3f-b7a1-b580c5ac106b),volume_type_id=86f3789d-733b-4f3f-b7a1-b580c5ac106b)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Creating volume 3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:28:43 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:28:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:43 devstack sudo[94396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6 1073741824
Sep 29 12:28:43 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:44 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6 1073741824" returned: 0 in 0.556s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:44 devstack sudo[94403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6
Sep 29 12:28:44 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:44 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6" returned: 0 in 0.299s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458038b9-ff08-4d17-a7da-12a56a287c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b7c5e9-1594-4f93-96b0-7e1109b0ccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "cinder-e02781ba-9d01-4748-9046-fa9d5691f75c-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:28:44 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Volume volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6 (3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6): created successfully
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b7c5e9-1594-4f93-96b0-7e1109b0ccd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Flow 'volume_create_manager' (ace5b34c-3d0a-41d5-931c-20c0d6016554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Lock "cinder-e02781ba-9d01-4748-9046-fa9d5691f75c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:28:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-421e83c2-e14d-4168-9294-d9a97c97411f tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Created volume successfully.
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "cinder-quobyte-e02781ba-9d01-4748-9046-fa9d5691f75c" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Lock "cinder-quobyte-e02781ba-9d01-4748-9046-fa9d5691f75c" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39ba9ca-3015-49d1-8c20-f17cbcb0b57f]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:28:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e02781ba-9d01-4748-9046-fa9d5691f75c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:44 devstack sudo[94406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e02781ba-9d01-4748-9046-fa9d5691f75c
Sep 29 12:28:44 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:45 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e02781ba-9d01-4748-9046-fa9d5691f75c" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e02781ba-9d01-4748-9046-fa9d5691f75c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:45 devstack sudo[94412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e02781ba-9d01-4748-9046-fa9d5691f75c
Sep 29 12:28:45 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:45 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e02781ba-9d01-4748-9046-fa9d5691f75c" returned: 0 in 0.250s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Lock "cinder-quobyte-e02781ba-9d01-4748-9046-fa9d5691f75c" released by "delete_volume" :: held 0.688s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=51,cinder:UPDATE=41,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Created reservations ['7e196454-5c8e-4c02-b069-4a2956dd0654', 'd8b9a4fe-2644-4803-b0be-169a228ebc50', '5f0e9f8e-2cfa-4968-ac79-96c5d49f44aa', '09fe03d1-8d47-48ed-ad4a-2e4baccb1054'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:45 devstack sudo[94415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:28:45 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "cinder-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Lock "cinder-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:28:45 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=58,cinder:UPDATE=47,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "cinder-quobyte-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Lock "cinder-quobyte-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd" acquired by "delete_volume" :: waited 0.058s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddcd3d9-a227-405e-85f8-a014e9bfd3be]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:46 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.671s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:28:46 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Deleted volume successfully.
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4720f451-5157-40b8-b0c4-5a8f440db909 tempest-AttachVolumeTestJSON-1227494649 None] Lock "cinder-e02781ba-9d01-4748-9046-fa9d5691f75c-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:28:46 devstack sudo[94451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd
Sep 29 12:28:46 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-644ff15e-3c5b-4559-86aa-0a78f9b6cade tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-644ff15e-3c5b-4559-86aa-0a78f9b6cade tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-644ff15e-3c5b-4559-86aa-0a78f9b6cade tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-644ff15e-3c5b-4559-86aa-0a78f9b6cade tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-644ff15e-3c5b-4559-86aa-0a78f9b6cade tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-644ff15e-3c5b-4559-86aa-0a78f9b6cade tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:46 devstack sudo[94506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:28:46 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:46 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd" returned: 0 in 0.744s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:46 devstack sudo[94514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd
Sep 29 12:28:47 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:47 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-644ff15e-3c5b-4559-86aa-0a78f9b6cade tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.528s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-644ff15e-3c5b-4559-86aa-0a78f9b6cade tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:28:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-644ff15e-3c5b-4559-86aa-0a78f9b6cade tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Retype volume completed successfully.
Sep 29 12:28:47 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd" returned: 0 in 0.504s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Lock "cinder-quobyte-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd" released by "delete_volume" :: held 1.361s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Created reservations ['b908d7dc-d1a0-434f-adbc-fc3e135db911', '78d048bc-08d4-4abe-96ef-8234f8a53af2', '2b245b1f-d0e3-4fae-a3a2-f4d5022d5820', '41c0f2c5-b0f4-4a45-896d-5c9f6b9c4d8a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:47 devstack sudo[94547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:28:47 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Acquiring lock "cinder-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Lock "cinder-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:28:47 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.378s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:28:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Deleted volume successfully.
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Acquiring lock "cinder-quobyte-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:28:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Lock "cinder-quobyte-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:28:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-96636739-8f2e-4402-986b-7db3fffcc868 tempest-AttachVolumeTestJSON-1227494649 None] Lock "cinder-3a021aaa-6bc0-49ed-a3eb-8dc2f665affd-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:28:48 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13f7885-329c-4892-96a6-f5ae74056bd9]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:28:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:48 devstack sudo[94550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6
Sep 29 12:28:48 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "cinder-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:28:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Lock "cinder-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:28:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "cinder-quobyte-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:28:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Lock "cinder-quobyte-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:28:48 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21964e0-89b9-4cc7-bc1e-2fda4d99c186]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:28:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:48 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6" returned: 0 in 0.553s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:48 devstack sudo[94558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6
Sep 29 12:28:48 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:48 devstack sudo[94557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc
Sep 29 12:28:48 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:49 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6" returned: 0 in 0.622s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Lock "cinder-quobyte-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6" released by "delete_volume" :: held 1.237s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:28:49 devstack cinder-volume[86369]: WARNING cinder.quota [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:28:49 devstack cinder-volume[86369]: WARNING cinder.quota [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Created reservations ['e707c0ef-d47e-4d5a-856c-f8af475cf570', '5f83f556-f155-4eae-bbb6-661122f47d04', 'fa883928-e532-4455-bbc8-35f5bbbc3387', 'cbb1ece9-d691-4fb1-9dd8-5a50293ca07f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:28:49 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc" returned: 0 in 0.806s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:49 devstack sudo[94565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc
Sep 29 12:28:49 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:49 devstack sudo[94567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:28:49 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:49 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.311s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:28:49 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Deleted volume successfully.
Sep 29 12:28:49 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc" returned: 0 in 0.448s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Lock "cinder-quobyte-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc" released by "delete_volume" :: held 1.324s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e35cbcf4-bb7e-44bd-b638-a7dbdc9c10f8 tempest-VolumeRetypeWithoutMigrationTest-1661975518 None] Lock "cinder-3b4fbe4e-0356-4a63-b0a4-45b9bdcfb0f6-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Created reservations ['19bd8cf4-5507-40c2-823c-624450d31893', 'f23004c3-7d6c-4b99-84e1-ff73464b0fd2', '2c132670-04d9-48a8-88f1-054873037f20', '47b30093-dd08-4ce7-abbd-3cc7a6ed6518'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:49 devstack sudo[94571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:28:49 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:50 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.269s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:50 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:28:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Deleted volume successfully.
Sep 29 12:28:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ba8c09da-1f3b-4c73-969c-b5ac86813e9f tempest-AttachVolumeTestJSON-1227494649 None] Lock "cinder-102293e3-4ce2-44eb-a2c7-fc9f5baa12cc-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Flow 'volume_create_manager' (52f22283-67e9-416b-b49f-133ed925a452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d0f826-e147-4315-8a74-31d657838bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d0f826-e147-4315-8a74-31d657838bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1338638006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c36e2c355f54263b63db28354b09208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:28:54Z,use_quota=True,user_id='acbd5bee07924936a666b7b38c295b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364889fc-a700-42b6-be3b-e7962bb6706b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364889fc-a700-42b6-be3b-e7962bb6706b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b8bfdd-350e-4917-ac23-5fa3988a27f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b8bfdd-350e-4917-ac23-5fa3988a27f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2', 'volume_name': 'volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2939920c-96c5-4464-8258-11f6c550b15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2939920c-96c5-4464-8258-11f6c550b15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61445e91-912e-47b9-bff8-d8c0a2ad91bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:54 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Volume e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2', 'volume_size': 1}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1338638006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c36e2c355f54263b63db28354b09208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:28:54Z,use_quota=True,user_id='acbd5bee07924936a666b7b38c295b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Creating volume e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:28:54 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:28:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:54 devstack sudo[94581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2 1073741824
Sep 29 12:28:54 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:55 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2 1073741824" returned: 0 in 0.899s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:28:55 devstack sudo[94587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2
Sep 29 12:28:55 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:28:55 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root
Sep 29 12:28:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2" returned: 0 in 0.505s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:28:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:28:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61445e91-912e-47b9-bff8-d8c0a2ad91bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1150ff47-9bc6-476b-a888-ba838137d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:28:55 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Volume volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2 (e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2): created successfully
Sep 29 12:28:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1150ff47-9bc6-476b-a888-ba838137d287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:28:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Flow 'volume_create_manager' (52f22283-67e9-416b-b49f-133ed925a452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:28:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2803959c-9891-4f9d-8889-04361e2cb2b1 tempest-AttachVolumeNegativeTest-1906280415 None] Created volume successfully.
Sep 29 12:28:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-a789d2ed-c559-4aa2-a9fd-3c2f8cac149d req-7714d9e7-e128-4d1a-86ad-9277d30b6b7c tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:28:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-a789d2ed-c559-4aa2-a9fd-3c2f8cac149d req-7714d9e7-e128-4d1a-86ad-9277d30b6b7c tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:28:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-a789d2ed-c559-4aa2-a9fd-3c2f8cac149d req-7714d9e7-e128-4d1a-86ad-9277d30b6b7c tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:28:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-a789d2ed-c559-4aa2-a9fd-3c2f8cac149d req-7714d9e7-e128-4d1a-86ad-9277d30b6b7c tempest-AttachVolumeNegativeTest-1906280415 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dde5b714-6193-4859-9048-0afe2ad0318d', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:28:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-a789d2ed-c559-4aa2-a9fd-3c2f8cac149d req-7714d9e7-e128-4d1a-86ad-9277d30b6b7c tempest-AttachVolumeNegativeTest-1906280415 None] attachment_update completed successfully.
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Flow 'volume_create_manager' (0811686b-22a8-4f39-b220-c4538029d142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58719a25-3533-434e-9253-f3072b0818bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58719a25-3533-434e-9253-f3072b0818bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1158730750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7ea64b-0284-4c8b-9771-7e34513bd328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57946e5abdf459d952c785c0bd2bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:03Z,use_quota=True,user_id='2b7dc64f32b3405b9df8ca5a5a048e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02d4dc8-46a0-4c03-9feb-ace6ee6625af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02d4dc8-46a0-4c03-9feb-ace6ee6625af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfb7f59-9a46-4cee-8424-2554879e8ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfb7f59-9a46-4cee-8424-2554879e8ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d7ea64b-0284-4c8b-9771-7e34513bd328', 'volume_name': 'volume-7d7ea64b-0284-4c8b-9771-7e34513bd328', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f487358-e162-4bdc-bcc3-f1a55d833571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f487358-e162-4bdc-bcc3-f1a55d833571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b48e7f-6cb0-47fe-acc1-13f372de733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:03 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Volume 7d7ea64b-0284-4c8b-9771-7e34513bd328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d7ea64b-0284-4c8b-9771-7e34513bd328', 'volume_size': 1}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1158730750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7ea64b-0284-4c8b-9771-7e34513bd328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57946e5abdf459d952c785c0bd2bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:03Z,use_quota=True,user_id='2b7dc64f32b3405b9df8ca5a5a048e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Creating volume 7d7ea64b-0284-4c8b-9771-7e34513bd328 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:29:03 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:03 devstack sudo[95149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328 1073741824
Sep 29 12:29:03 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-0022b37e-bb43-4236-88ab-43bbe01dd72c req-2a003f79-a097-4fd0-80f7-fb33a38b1dff tempest-AttachVolumeNegativeTest-1906280415 None] Terminate volume connection completed successfully.
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0022b37e-bb43-4236-88ab-43bbe01dd72c req-2a003f79-a097-4fd0-80f7-fb33a38b1dff tempest-AttachVolumeNegativeTest-1906280415 None] Deleting attachment dde5b714-6193-4859-9048-0afe2ad0318d. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:29:03 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328 1073741824" returned: 0 in 0.620s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:03 devstack sudo[95158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328
Sep 29 12:29:03 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:04 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328" returned: 0 in 0.313s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:29:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b48e7f-6cb0-47fe-acc1-13f372de733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7ea64b-0284-4c8b-9771-7e34513bd328', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f06639-bfb9-43a6-97a4-999c254f056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Volume volume-7d7ea64b-0284-4c8b-9771-7e34513bd328 (7d7ea64b-0284-4c8b-9771-7e34513bd328): created successfully
Sep 29 12:29:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f06639-bfb9-43a6-97a4-999c254f056e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Flow 'volume_create_manager' (0811686b-22a8-4f39-b220-c4538029d142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-870705fb-29f2-4dfb-a6d1-5e2eec310d42 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Created volume successfully.
Sep 29 12:29:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Creating offline snapshot 57a587b2-ba4b-4841-831f-554b39284a46 of volume 7d7ea64b-0284-4c8b-9771-7e34513bd328 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:29:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebdc90e-7b5d-4225-bfe0-1925d3252b86]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:06 devstack sudo[95187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328
Sep 29 12:29:06 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Flow 'volume_create_manager' (0c405172-b5f4-4a1a-8ea4-925239a9a11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaaa8d6-8774-438f-8106-7887bea59e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaaa8d6-8774-438f-8106-7887bea59e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-41865821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f68624-4b12-4a3b-8c7d-c4b25ea4a570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3229e620f37f4fa295174bcf3c59d8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:06Z,use_quota=True,user_id='a6899229ebc34323a91f83977efa9276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bd546c-c218-463a-ae4e-97d6416fcd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bd546c-c218-463a-ae4e-97d6416fcd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c9c73f-657c-4924-8001-344b2295d8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c9c73f-657c-4924-8001-344b2295d8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f68624-4b12-4a3b-8c7d-c4b25ea4a570', 'volume_name': 'volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83b9a98-2294-46d1-8ea9-fe1648ac28ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83b9a98-2294-46d1-8ea9-fe1648ac28ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b1399c-8474-4aea-b456-47449dce0185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Volume a2f68624-4b12-4a3b-8c7d-c4b25ea4a570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570', 'volume_size': 1}
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:06 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328" returned: 0 in 0.798s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:06 devstack sudo[95209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46 1G
Sep 29 12:29:06 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:07 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46 1G" returned: 0 in 0.649s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d7ea64b-0284-4c8b-9771-7e34513bd328 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:07 devstack sudo[95224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d7ea64b-0284-4c8b-9771-7e34513bd328 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46
Sep 29 12:29:07 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:07 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d7ea64b-0284-4c8b-9771-7e34513bd328 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46" returned: 0 in 0.397s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:07 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46 is being set with open permissions: ugo+rw
Sep 29 12:29:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:29:07 devstack sudo[95231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46
Sep 29 12:29:07 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:07 devstack sudo[95234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:07 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:08 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46" returned: 0 in 0.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:08 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.368s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:29:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:29:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:29:08 devstack sudo[95240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.info
Sep 29 12:29:08 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:08 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.info" returned: 0 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:08 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.info is being set with open permissions: ugo+rw
Sep 29 12:29:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:08 devstack sudo[95244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.info
Sep 29 12:29:08 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:08 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.info" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.184s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.321s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-41865821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f68624-4b12-4a3b-8c7d-c4b25ea4a570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3229e620f37f4fa295174bcf3c59d8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:06Z,use_quota=True,user_id='a6899229ebc34323a91f83977efa9276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Creating volume a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:29:09 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:09 devstack sudo[95247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 1073741824
Sep 29 12:29:09 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cdc67447-e8d6-4332-ae64-7ca5b9714044 tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Create snapshot completed successfully
Sep 29 12:29:09 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 1073741824" returned: 0 in 0.550s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:09 devstack sudo[95252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570
Sep 29 12:29:09 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:09 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b1399c-8474-4aea-b456-47449dce0185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a29679-0e6c-44f4-bec2-d1408811817a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:09 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Volume volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 (a2f68624-4b12-4a3b-8c7d-c4b25ea4a570): created successfully
Sep 29 12:29:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a29679-0e6c-44f4-bec2-d1408811817a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Flow 'volume_create_manager' (0c405172-b5f4-4a1a-8ea4-925239a9a11c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-6b075c0a-413b-40e3-aba8-16b2fecef169 req-d7962148-9f21-42c1-8532-4f6c9ad9c35b tempest-VolumesSnapshotsTestJSON-1264447600 None] Created volume successfully.
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Flow 'volume_create_manager' (fbc92fc8-2981-45a4-abb6-788f0640bf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d125511f-300a-4bad-8e67-9ad13ea7059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d125511f-300a-4bad-8e67-9ad13ea7059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-394202892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee91f149-dfc3-4c81-816d-68b9466a4019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546678a5611d490b8332f26f6959b21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:10Z,use_quota=True,user_id='0ca4cd58f2eb409fb500478d428587aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96e5716-3f47-4169-81a8-341441ba9e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96e5716-3f47-4169-81a8-341441ba9e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7f0b54-b29c-4383-9685-f2cc83e78481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7f0b54-b29c-4383-9685-f2cc83e78481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee91f149-dfc3-4c81-816d-68b9466a4019', 'volume_name': 'volume-ee91f149-dfc3-4c81-816d-68b9466a4019', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca9f94d-838c-4282-b779-c940a4dc0ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca9f94d-838c-4282-b779-c940a4dc0ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39af80b-871e-4df9-8cff-16c3853156a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:10 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Volume ee91f149-dfc3-4c81-816d-68b9466a4019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee91f149-dfc3-4c81-816d-68b9466a4019', 'volume_size': 1}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-394202892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee91f149-dfc3-4c81-816d-68b9466a4019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546678a5611d490b8332f26f6959b21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:10Z,use_quota=True,user_id='0ca4cd58f2eb409fb500478d428587aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Creating volume ee91f149-dfc3-4c81-816d-68b9466a4019 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:29:10 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ee91f149-dfc3-4c81-816d-68b9466a4019 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:10 devstack sudo[95257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ee91f149-dfc3-4c81-816d-68b9466a4019 1073741824
Sep 29 12:29:10 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Acquiring lock "cinder-57a587b2-ba4b-4841-831f-554b39284a46-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "cinder-57a587b2-ba4b-4841-831f-554b39284a46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Acquiring lock "cinder-quobyte-7d7ea64b-0284-4c8b-9771-7e34513bd328" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "cinder-quobyte-7d7ea64b-0284-4c8b-9771-7e34513bd328" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Acquiring lock "cinder-quobyte-57a587b2-ba4b-4841-831f-554b39284a46" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "cinder-quobyte-57a587b2-ba4b-4841-831f-554b39284a46" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Deleting offline snapshot 57a587b2-ba4b-4841-831f-554b39284a46 of volume 7d7ea64b-0284-4c8b-9771-7e34513bd328 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] snapshot_file for this snap is: volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0cd310-2a2f-4da1-8ee5-9e243ba7979e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:11 devstack sudo[95269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46
Sep 29 12:29:11 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:11 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ee91f149-dfc3-4c81-816d-68b9466a4019 1073741824" returned: 0 in 0.812s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "cinder-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Lock "cinder-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ee91f149-dfc3-4c81-816d-68b9466a4019 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "cinder-quobyte-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:11 devstack sudo[95271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ee91f149-dfc3-4c81-816d-68b9466a4019
Sep 29 12:29:11 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Lock "cinder-quobyte-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3938a4-03f9-4652-bd9c-7096ae1f41d1]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:11 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46" returned: 0 in 0.570s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d7ea64b-0284-4c8b-9771-7e34513bd328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4c300c-b5be-43f0-b6ab-bcee1521c3ab]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:11 devstack sudo[95273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2
Sep 29 12:29:11 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:11 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ee91f149-dfc3-4c81-816d-68b9466a4019" returned: 0 in 0.284s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.102s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] Creating offline snapshot 6cf2f1ae-de4f-4856-8486-610a34c7c452 of volume a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39af80b-871e-4df9-8cff-16c3853156a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee91f149-dfc3-4c81-816d-68b9466a4019', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:11 devstack sudo[95277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05498092-2b03-45a0-b4b8-1ebec085f347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:11 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3732a8d9-9c9c-4a86-92aa-2b4d7c0b05d0]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Volume volume-ee91f149-dfc3-4c81-816d-68b9466a4019 (ee91f149-dfc3-4c81-816d-68b9466a4019): created successfully
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05498092-2b03-45a0-b4b8-1ebec085f347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Flow 'volume_create_manager' (fbc92fc8-2981-45a4-abb6-788f0640bf11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ef58f62f-44ad-4d97-9d00-33b8bb901248 tempest-ServersNegativeTestJSON-753958120 None] Created volume successfully.
Sep 29 12:29:12 devstack sudo[95281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570
Sep 29 12:29:12 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:12 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2" returned: 0 in 0.425s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:12 devstack sudo[95286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2
Sep 29 12:29:12 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:12 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328" returned: 0 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:12 devstack sudo[95294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46
Sep 29 12:29:12 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:12 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570" returned: 0 in 0.442s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:12 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Lock "cinder-quobyte-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2" released by "delete_volume" :: held 0.755s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:12 devstack sudo[95300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452 1G
Sep 29 12:29:12 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Created reservations ['0df5f67f-fb15-491b-aaa3-ff4cb3863689', '129b413f-0bf4-4c4d-b84d-bdcfb0454687', '16f64b11-8841-4fe4-b8f5-c0ae3c5c186b', 'c40e7d93-4e88-4924-aa13-fdd682e18906'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:12 devstack sudo[95305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:12 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:12 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46" returned: 0 in 0.412s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:12 devstack sudo[95309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46
Sep 29 12:29:12 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "cinder-e27ec9eb-b413-461f-b76b-e5dcc50fcc96-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Lock "cinder-e27ec9eb-b413-461f-b76b-e5dcc50fcc96-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:12 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.430s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "cinder-quobyte-e27ec9eb-b413-461f-b76b-e5dcc50fcc96" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Deleted volume successfully.
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Lock "cinder-quobyte-e27ec9eb-b413-461f-b76b-e5dcc50fcc96" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:13 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b954ddb-6c24-4f18-9841-8ffbd328611e tempest-AttachVolumeNegativeTest-1906280415 None] Lock "cinder-e2aa3509-607c-40b2-b8de-fb6c8a3fa6a2-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452 1G" returned: 0 in 0.664s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:13 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328.57a587b2-ba4b-4841-831f-554b39284a46" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:13 devstack sudo[95315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[62631260-5815-4090-8da5-9bdb17392979]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:13 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "cinder-quobyte-57a587b2-ba4b-4841-831f-554b39284a46" released by "_delete_snapshot" :: held 2.046s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "cinder-quobyte-7d7ea64b-0284-4c8b-9771-7e34513bd328" released by "delete_snapshot" :: held 2.086s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:13 devstack sudo[95317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96
Sep 29 12:29:13 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:13 devstack cinder-volume[86369]: WARNING cinder.quota [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Created reservations ['d13cacc3-0fff-414d-bab0-4a4b2fc5ce40', 'fbeec3ad-23ce-4f88-90e7-e1fae2071288', '7f3dad3a-aa54-4cbc-8198-b959ac435ca0', 'a6d02d25-2a27-45df-a26b-9c0a8b151aa1'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Delete snapshot completed successfully.
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d913bfe2-6a39-44d5-97fc-45b0309ec98c tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "cinder-57a587b2-ba4b-4841-831f-554b39284a46-delete_snapshot" released by "delete_snapshot" :: held 2.275s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:13 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:13 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452 is being set with open permissions: ugo+rw
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:13 devstack sudo[95324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452
Sep 29 12:29:13 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:13 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96" returned: 0 in 0.455s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:13 devstack sudo[95327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96
Sep 29 12:29:13 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:13 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:13 devstack sudo[95331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.info
Sep 29 12:29:13 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:13 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-e27ec9eb-b413-461f-b76b-e5dcc50fcc96" returned: 0 in 0.282s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Lock "cinder-quobyte-e27ec9eb-b413-461f-b76b-e5dcc50fcc96" released by "delete_volume" :: held 0.821s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:13 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Created reservations ['320e22be-a6d4-424f-b064-df195b1749db', 'eb4b4bc8-11f9-4e3a-b23d-48f043571524', 'b23132c9-22da-4006-8cbe-e14e830d28dd', '139710ce-e63e-490e-8b06-c5cb290cebfb'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:14 devstack sudo[95335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:14 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:14 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.info" returned: 0 in 0.322s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:14 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.info is being set with open permissions: ugo+rw
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:14 devstack sudo[95337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.info
Sep 29 12:29:14 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Flow 'volume_create_manager' (2cf2e615-4243-47a5-827a-424598f01a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19329558-f18a-4be1-bb49-d31ddbbc0fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19329558-f18a-4be1-bb49-d31ddbbc0fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1006106803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e038a4a-6945-414c-bb5d-8508519f9454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546678a5611d490b8332f26f6959b21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:14Z,use_quota=True,user_id='0ca4cd58f2eb409fb500478d428587aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5f6f71-a79c-44e8-af28-07773afb7b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5f6f71-a79c-44e8-af28-07773afb7b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917e4436-ef8a-489b-b919-b905ff19e60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917e4436-ef8a-489b-b919-b905ff19e60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e038a4a-6945-414c-bb5d-8508519f9454', 'volume_name': 'volume-7e038a4a-6945-414c-bb5d-8508519f9454', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa50a849-bc76-4254-9b73-247aaff6416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa50a849-bc76-4254-9b73-247aaff6416a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f66c41-03bb-4f2d-9420-58ba41f87465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Volume 7e038a4a-6945-414c-bb5d-8508519f9454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e038a4a-6945-414c-bb5d-8508519f9454', 'volume_size': 1}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:14 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.352s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Deleted volume successfully.
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1f142a6a-29bf-4ea0-a618-f54e78f4ca2f tempest-AttachVolumeNegativeTest-1906280415 None] Lock "cinder-e27ec9eb-b413-461f-b76b-e5dcc50fcc96-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "cinder-f04150d9-405a-45b6-a130-134c2bd3e66d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Acquiring lock "cinder-7d7ea64b-0284-4c8b-9771-7e34513bd328-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:14 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.info" returned: 0 in 0.348s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.567s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.167s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1006106803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e038a4a-6945-414c-bb5d-8508519f9454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546678a5611d490b8332f26f6959b21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:14Z,use_quota=True,user_id='0ca4cd58f2eb409fb500478d428587aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Creating volume 7e038a4a-6945-414c-bb5d-8508519f9454 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:29:14 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7e038a4a-6945-414c-bb5d-8508519f9454 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:14 devstack sudo[95341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7e038a4a-6945-414c-bb5d-8508519f9454 1073741824
Sep 29 12:29:14 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "cinder-f04150d9-405a-45b6-a130-134c2bd3e66d-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "cinder-7d7ea64b-0284-4c8b-9771-7e34513bd328-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-622805e0-beb3-4660-b3f7-4cb4f093ea53 req-e093bce3-1339-4db4-98b8-ebbd50a2e84f tempest-VolumesSnapshotsTestJSON-1264447600 None] Create snapshot completed successfully
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "cinder-quobyte-f04150d9-405a-45b6-a130-134c2bd3e66d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "cinder-quobyte-f04150d9-405a-45b6-a130-134c2bd3e66d" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Acquiring lock "cinder-quobyte-7d7ea64b-0284-4c8b-9771-7e34513bd328" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ea84dd-e2dc-4222-8065-0f8eb5557374]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f04150d9-405a-45b6-a130-134c2bd3e66d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "cinder-quobyte-7d7ea64b-0284-4c8b-9771-7e34513bd328" acquired by "delete_volume" :: waited 0.043s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[65800356-da7d-4fb0-8940-6202648a65a3]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:14 devstack sudo[95343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f04150d9-405a-45b6-a130-134c2bd3e66d
Sep 29 12:29:14 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:14 devstack sudo[95347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328
Sep 29 12:29:14 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:14 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7e038a4a-6945-414c-bb5d-8508519f9454 1073741824" returned: 0 in 0.476s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7e038a4a-6945-414c-bb5d-8508519f9454 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:15 devstack sudo[95350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7e038a4a-6945-414c-bb5d-8508519f9454
Sep 29 12:29:15 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:15 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f04150d9-405a-45b6-a130-134c2bd3e66d" returned: 0 in 0.443s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f04150d9-405a-45b6-a130-134c2bd3e66d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:15 devstack sudo[95358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f04150d9-405a-45b6-a130-134c2bd3e66d
Sep 29 12:29:15 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:15 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328" returned: 0 in 0.394s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:15 devstack sudo[95360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328
Sep 29 12:29:15 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:15 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7e038a4a-6945-414c-bb5d-8508519f9454" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f66c41-03bb-4f2d-9420-58ba41f87465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e038a4a-6945-414c-bb5d-8508519f9454', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab80801-dd4a-4ee2-8f1b-1469dd6630f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:15 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Volume volume-7e038a4a-6945-414c-bb5d-8508519f9454 (7e038a4a-6945-414c-bb5d-8508519f9454): created successfully
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab80801-dd4a-4ee2-8f1b-1469dd6630f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Flow 'volume_create_manager' (2cf2e615-4243-47a5-827a-424598f01a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Acquiring lock "cinder-6cf2f1ae-de4f-4856-8486-610a34c7c452-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-439cbd26-3da9-45c3-afad-6ec6f124385a tempest-ServersNegativeTestJSON-753958120 None] Created volume successfully.
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "cinder-6cf2f1ae-de4f-4856-8486-610a34c7c452-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Acquiring lock "cinder-quobyte-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "cinder-quobyte-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Acquiring lock "cinder-quobyte-6cf2f1ae-de4f-4856-8486-610a34c7c452" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "cinder-quobyte-6cf2f1ae-de4f-4856-8486-610a34c7c452" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:15 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Deleting offline snapshot 6cf2f1ae-de4f-4856-8486-610a34c7c452 of volume a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] snapshot_file for this snap is: volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f04150d9-405a-45b6-a130-134c2bd3e66d" returned: 0 in 0.337s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf43f205-8fb4-4e7e-a471-3da868fa10ae]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "cinder-quobyte-f04150d9-405a-45b6-a130-134c2bd3e66d" released by "delete_volume" :: held 0.842s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:15 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7d7ea64b-0284-4c8b-9771-7e34513bd328" returned: 0 in 0.347s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "cinder-quobyte-7d7ea64b-0284-4c8b-9771-7e34513bd328" released by "delete_volume" :: held 0.818s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Created reservations ['f008ec60-dd11-45cb-842a-734a6681ad3f', 'b82d900e-0868-42da-8552-53a7f0e95cc8', '3da0276b-a828-4a09-87a3-dd0b65a69741', '756c4a86-599e-4d12-a0ce-730db7d53d8d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:15 devstack sudo[95365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452
Sep 29 12:29:15 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Created reservations ['0e3f778c-c506-4876-95d2-deb6eca80bbe', '9d9fd858-7472-4e28-8f38-7471a97655a0', '9c64a44f-df81-412a-abcc-951503a27207', '53e383b5-0afd-46f6-8fe0-364b5d3be7e4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:15 devstack sudo[95367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:15 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:15 devstack sudo[95369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:15 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:15 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452" returned: 0 in 0.416s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[40927283-505f-44a9-a979-088cde04d938]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:16 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.299s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Deleted volume successfully.
Sep 29 12:29:16 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.280s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Deleted volume successfully.
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-02dbf778-7972-414b-99ca-b90399e7b7e8 tempest-AttachVolumeNegativeTest-1906280415 None] Lock "cinder-f04150d9-405a-45b6-a130-134c2bd3e66d-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:16 devstack sudo[95374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570
Sep 29 12:29:16 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bdbfa859-19f4-4254-9c47-31eb55ed70ad tempest-VolumeSnapshotQuotasNegativeTestJSON-54603958 None] Lock "cinder-7d7ea64b-0284-4c8b-9771-7e34513bd328-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:16 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570" returned: 0 in 0.394s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:16 devstack sudo[95381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452
Sep 29 12:29:16 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Acquiring lock "cinder-7e038a4a-6945-414c-bb5d-8508519f9454-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Lock "cinder-7e038a4a-6945-414c-bb5d-8508519f9454-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Acquiring lock "cinder-quobyte-7e038a4a-6945-414c-bb5d-8508519f9454" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Lock "cinder-quobyte-7e038a4a-6945-414c-bb5d-8508519f9454" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[696d29b8-06fd-4f38-9a43-bffcc02818ff]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7e038a4a-6945-414c-bb5d-8508519f9454 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:16 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452" returned: 0 in 0.466s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:16 devstack sudo[95386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7e038a4a-6945-414c-bb5d-8508519f9454
Sep 29 12:29:16 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:16 devstack sudo[95387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452
Sep 29 12:29:16 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:17 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7e038a4a-6945-414c-bb5d-8508519f9454" returned: 0 in 0.406s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7e038a4a-6945-414c-bb5d-8508519f9454 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:17 devstack sudo[95395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7e038a4a-6945-414c-bb5d-8508519f9454
Sep 29 12:29:17 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:17 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570.6cf2f1ae-de4f-4856-8486-610a34c7c452" returned: 0 in 0.347s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "cinder-quobyte-6cf2f1ae-de4f-4856-8486-610a34c7c452" released by "_delete_snapshot" :: held 1.765s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "cinder-quobyte-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570" released by "delete_snapshot" :: held 1.792s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.quota [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Created reservations ['a1c390b9-f40a-4fac-9e37-3ba46623885f', 'c5cfdc84-8276-4eac-bf7b-3579f15be212', '9f2f1a49-2bef-4915-87d1-8868e4122161', 'b8264356-5690-4ebe-a62a-2bfe9bac92f6'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Delete snapshot completed successfully.
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-2fb778b4-4125-4a7e-ab73-1ec2d94ca23f req-02347228-793f-47fa-aa16-609d2ee5fec3 tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "cinder-6cf2f1ae-de4f-4856-8486-610a34c7c452-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:17 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7e038a4a-6945-414c-bb5d-8508519f9454" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Lock "cinder-quobyte-7e038a4a-6945-414c-bb5d-8508519f9454" released by "delete_volume" :: held 0.785s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Created reservations ['dd40114d-16fa-480d-b39a-657a8b6c8bf4', 'f23afb32-0e0e-4f61-b110-d84d4fe3b91d', 'f09ee7e2-9a07-489f-8eeb-a68c27d50328', 'ed75c405-a00f-4087-9d2c-67a9f7e95d4d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:17 devstack sudo[95398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:17 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Acquiring lock "cinder-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "cinder-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Acquiring lock "cinder-quobyte-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Acquiring lock "cinder-ee91f149-dfc3-4c81-816d-68b9466a4019-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "cinder-quobyte-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570" acquired by "delete_volume" :: waited 0.040s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Lock "cinder-ee91f149-dfc3-4c81-816d-68b9466a4019-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f32dc3e-a3a1-46df-91d0-c92bb89a2524]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Acquiring lock "cinder-quobyte-ee91f149-dfc3-4c81-816d-68b9466a4019" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Lock "cinder-quobyte-ee91f149-dfc3-4c81-816d-68b9466a4019" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[15df1712-e157-4f0b-804a-2db7820e9995]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ee91f149-dfc3-4c81-816d-68b9466a4019 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:18 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.457s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Deleted volume successfully.
Sep 29 12:29:18 devstack sudo[95400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570
Sep 29 12:29:18 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-117637c1-d609-44e7-a3e2-24ae25c7d9f9 tempest-ServersNegativeTestJSON-753958120 None] Lock "cinder-7e038a4a-6945-414c-bb5d-8508519f9454-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:18 devstack sudo[95402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ee91f149-dfc3-4c81-816d-68b9466a4019
Sep 29 12:29:18 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:18 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570" returned: 0 in 0.464s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:18 devstack sudo[95408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570
Sep 29 12:29:18 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:18 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ee91f149-dfc3-4c81-816d-68b9466a4019" returned: 0 in 0.550s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ee91f149-dfc3-4c81-816d-68b9466a4019 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:18 devstack sudo[95414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ee91f149-dfc3-4c81-816d-68b9466a4019
Sep 29 12:29:18 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:18 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570" returned: 0 in 0.338s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "cinder-quobyte-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570" released by "delete_volume" :: held 0.936s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG cinder.quota [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Created reservations ['a2ba8595-8dd4-4070-b772-ca358b2bfc82', 'bd6adc3e-2fb5-4803-b561-c8881e1c156c', '313a2fd9-7c23-4661-aa17-785ff260e3c8', '91ae33f6-d7a3-4f1a-990b-5f88f3e41a60'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:19 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ee91f149-dfc3-4c81-816d-68b9466a4019" returned: 0 in 0.415s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:19 devstack sudo[95418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:19 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Lock "cinder-quobyte-ee91f149-dfc3-4c81-816d-68b9466a4019" released by "delete_volume" :: held 1.035s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Created reservations ['e45404f0-b3db-4e9d-a3aa-32f6334b2a7e', '65d20d56-b452-4b33-8478-35efc9bc3f0c', '34d82497-f63d-49f1-a64f-cf34b21dd162', 'c0b43164-6cb5-4d9d-abe0-656775c9c8e8'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:19 devstack sudo[95420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:19 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:19 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.353s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG cinder.manager [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Deleted volume successfully.
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-91112e8c-db17-4cf7-bcaf-a1e05f5f511a req-93250f56-7a68-4b2b-8bfb-fa09e042d68d tempest-VolumesSnapshotsTestJSON-1264447600 None] Lock "cinder-a2f68624-4b12-4a3b-8c7d-c4b25ea4a570-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:19 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.414s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Deleted volume successfully.
Sep 29 12:29:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e5de735a-8079-4018-8572-0bdd3326e647 tempest-ServersNegativeTestJSON-753958120 None] Lock "cinder-ee91f149-dfc3-4c81-816d-68b9466a4019-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Flow 'volume_create_manager' (56844cd5-0b8b-4dbe-9946-9b652d2e10e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce05765-45bb-4786-b7e5-ad89f331b83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce05765-45bb-4786-b7e5-ad89f331b83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1486020262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b682d7f-2d15-472e-b777-d4ae4fb98289,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a068364db14c62acd3ec01a895612d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:25Z,use_quota=True,user_id='fc7d0fe2732e4d1494541b6709e1c50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe2d1f9-e2da-41c3-bb8f-b17b513c4e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe2d1f9-e2da-41c3-bb8f-b17b513c4e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f25d2ba-9120-4532-861e-afd153090075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f25d2ba-9120-4532-861e-afd153090075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b682d7f-2d15-472e-b777-d4ae4fb98289', 'volume_name': 'volume-2b682d7f-2d15-472e-b777-d4ae4fb98289', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b1ee6a-70f2-4546-ae2a-ad9be4f807d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b1ee6a-70f2-4546-ae2a-ad9be4f807d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ffbd15-c8aa-403d-8301-f3c2c0806105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Volume 2b682d7f-2d15-472e-b777-d4ae4fb98289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b682d7f-2d15-472e-b777-d4ae4fb98289', 'volume_size': 1}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1486020262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b682d7f-2d15-472e-b777-d4ae4fb98289,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a068364db14c62acd3ec01a895612d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:25Z,use_quota=True,user_id='fc7d0fe2732e4d1494541b6709e1c50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Creating volume 2b682d7f-2d15-472e-b777-d4ae4fb98289 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:29:25 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b682d7f-2d15-472e-b777-d4ae4fb98289 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:25 devstack sudo[95453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b682d7f-2d15-472e-b777-d4ae4fb98289 1073741824
Sep 29 12:29:25 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:25 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b682d7f-2d15-472e-b777-d4ae4fb98289 1073741824" returned: 0 in 0.579s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b682d7f-2d15-472e-b777-d4ae4fb98289 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:25 devstack sudo[95460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b682d7f-2d15-472e-b777-d4ae4fb98289
Sep 29 12:29:25 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:26 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b682d7f-2d15-472e-b777-d4ae4fb98289" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:29:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ffbd15-c8aa-403d-8301-f3c2c0806105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b682d7f-2d15-472e-b777-d4ae4fb98289', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72de87f-7e5c-4b54-93a9-767fafe88534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Volume volume-2b682d7f-2d15-472e-b777-d4ae4fb98289 (2b682d7f-2d15-472e-b777-d4ae4fb98289): created successfully
Sep 29 12:29:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72de87f-7e5c-4b54-93a9-767fafe88534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Flow 'volume_create_manager' (56844cd5-0b8b-4dbe-9946-9b652d2e10e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ecc8fd7d-68f4-42ff-a5ae-b1e06bb6a51e tempest-VolumesTestJSON-2126710872 None] Created volume successfully.
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Flow 'volume_create_manager' (0141e4f4-779e-459f-bfff-09555f788805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008b6c74-07c0-4a0d-8ed6-cd91baa0f6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008b6c74-07c0-4a0d-8ed6-cd91baa0f6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1148466896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73ce877-9ef4-4ee0-8b63-8f73c4e46f93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a068364db14c62acd3ec01a895612d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:28Z,use_quota=True,user_id='fc7d0fe2732e4d1494541b6709e1c50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e857f11c-6104-4e16-9953-9ffde1e88712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e857f11c-6104-4e16-9953-9ffde1e88712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50614045-05c7-4d8d-826b-edf43b3bc91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50614045-05c7-4d8d-826b-edf43b3bc91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73ce877-9ef4-4ee0-8b63-8f73c4e46f93', 'volume_name': 'volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea6631a-9716-421f-b9ac-e5288bb5e05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea6631a-9716-421f-b9ac-e5288bb5e05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60aed3dd-9b5a-4ea5-b2f0-c556b9c2b101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:28 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Volume d73ce877-9ef4-4ee0-8b63-8f73c4e46f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93', 'volume_size': 1}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1148466896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73ce877-9ef4-4ee0-8b63-8f73c4e46f93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a068364db14c62acd3ec01a895612d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:28Z,use_quota=True,user_id='fc7d0fe2732e4d1494541b6709e1c50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Creating volume d73ce877-9ef4-4ee0-8b63-8f73c4e46f93 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:29:28 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:28 devstack sudo[95465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93 1073741824
Sep 29 12:29:28 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:28 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93 1073741824" returned: 0 in 0.554s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:28 devstack sudo[95471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93
Sep 29 12:29:28 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:29 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:29:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60aed3dd-9b5a-4ea5-b2f0-c556b9c2b101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0080a11c-9c1b-49b4-9009-2ab973a34a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:29 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Volume volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93 (d73ce877-9ef4-4ee0-8b63-8f73c4e46f93): created successfully
Sep 29 12:29:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0080a11c-9c1b-49b4-9009-2ab973a34a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Flow 'volume_create_manager' (0141e4f4-779e-459f-bfff-09555f788805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1352884a-14cb-4950-ac2d-10c78fdffde9 tempest-VolumesTestJSON-2126710872 None] Created volume successfully.
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Flow 'volume_create_manager' (50fbf82d-40b7-46b4-8beb-1ee19a412e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1229db43-7f02-481b-b177-d7624121ea80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1229db43-7f02-481b-b177-d7624121ea80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-615331640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9ae6cd-d0cf-4562-9762-4ed8f3d56558,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a068364db14c62acd3ec01a895612d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:31Z,use_quota=True,user_id='fc7d0fe2732e4d1494541b6709e1c50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (736bf066-d832-40e0-bc32-a38dab28c050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (736bf066-d832-40e0-bc32-a38dab28c050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5c1afa-17c5-4898-aa88-a62e9927e990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5c1afa-17c5-4898-aa88-a62e9927e990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a9ae6cd-d0cf-4562-9762-4ed8f3d56558', 'volume_name': 'volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246580ff-b2f2-47a2-88f2-26c2b863d44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246580ff-b2f2-47a2-88f2-26c2b863d44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47933fc4-97e9-4a53-a5ea-bac4b08c8b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:30 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Volume 6a9ae6cd-d0cf-4562-9762-4ed8f3d56558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558', 'volume_size': 1}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-615331640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9ae6cd-d0cf-4562-9762-4ed8f3d56558,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9a068364db14c62acd3ec01a895612d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:31Z,use_quota=True,user_id='fc7d0fe2732e4d1494541b6709e1c50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Creating volume 6a9ae6cd-d0cf-4562-9762-4ed8f3d56558 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:29:30 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:29:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:31 devstack sudo[95475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558 1073741824
Sep 29 12:29:31 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:31 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558 1073741824" returned: 0 in 0.588s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:31 devstack sudo[95481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558
Sep 29 12:29:31 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:31 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:29:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47933fc4-97e9-4a53-a5ea-bac4b08c8b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22babf39-9160-40d3-9681-8c563ebe693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:31 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Volume volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558 (6a9ae6cd-d0cf-4562-9762-4ed8f3d56558): created successfully
Sep 29 12:29:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22babf39-9160-40d3-9681-8c563ebe693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Flow 'volume_create_manager' (50fbf82d-40b7-46b4-8beb-1ee19a412e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ad5de335-dbc7-415d-bb7f-ed5ab241a8f1 tempest-VolumesTestJSON-2126710872 None] Created volume successfully.
Sep 29 12:29:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Acquiring lock "cinder-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Lock "cinder-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Acquiring lock "cinder-quobyte-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Lock "cinder-quobyte-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:34 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b653ef0-7815-4c57-8754-74df3956ef9b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:34 devstack sudo[95486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558
Sep 29 12:29:34 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:34 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558" returned: 0 in 0.396s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:34 devstack sudo[95491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558
Sep 29 12:29:34 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:34 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558" returned: 0 in 0.300s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Lock "cinder-quobyte-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558" released by "delete_volume" :: held 0.755s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:34 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Created reservations ['3e34b301-5a09-4cc5-8895-a88ea8b43b75', '4dba078d-00f6-4b01-8b40-d36f07ddc6ac', '411735d5-afb6-4036-bc88-002a4591e94c', '79fadf38-9ae7-45e9-b8c5-515267562a48'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:35 devstack sudo[95494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:35 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Acquiring lock "cinder-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Lock "cinder-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:35 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.393s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Acquiring lock "cinder-quobyte-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Deleted volume successfully.
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Lock "cinder-quobyte-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-369e84d6-aff0-433c-b76b-88639974aa76 tempest-VolumesTestJSON-2126710872 None] Lock "cinder-6a9ae6cd-d0cf-4562-9762-4ed8f3d56558-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8912bb0d-0cbd-47c7-b438-4efad78b1993]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:35 devstack sudo[95497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93
Sep 29 12:29:35 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:36 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93" returned: 0 in 0.478s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:36 devstack sudo[95502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93
Sep 29 12:29:36 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:36 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Lock "cinder-quobyte-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93" released by "delete_volume" :: held 0.850s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Created reservations ['5826fad2-7812-403f-9ec0-d6c7c6b4f8ab', 'edb44995-06aa-4378-b414-7a7178f412a5', '6739500e-e140-43d2-9422-dccf0bc94bd3', 'e058c8c7-3856-4f1f-aec4-3ccf07c3763a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:36 devstack sudo[95505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:36 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Acquiring lock "cinder-2b682d7f-2d15-472e-b777-d4ae4fb98289-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Lock "cinder-2b682d7f-2d15-472e-b777-d4ae4fb98289-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Acquiring lock "cinder-quobyte-2b682d7f-2d15-472e-b777-d4ae4fb98289" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Lock "cinder-quobyte-2b682d7f-2d15-472e-b777-d4ae4fb98289" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd950006-0191-4277-9880-83d4b4bfac62]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b682d7f-2d15-472e-b777-d4ae4fb98289 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:36 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.381s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Deleted volume successfully.
Sep 29 12:29:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7aca00ad-014d-4ccf-b973-54a3d8f6e222 tempest-GroupSnapshotsTest-1083032981 None] Group tempest-GroupSnapshotsTest-Group-1304193523: creating
Sep 29 12:29:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22d76157-fd84-41c4-bfd4-59fe14555913 tempest-VolumesTestJSON-2126710872 None] Lock "cinder-d73ce877-9ef4-4ee0-8b63-8f73c4e46f93-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7aca00ad-014d-4ccf-b973-54a3d8f6e222 tempest-GroupSnapshotsTest-1083032981 None] Group tempest-GroupSnapshotsTest-Group-1304193523: created successfully
Sep 29 12:29:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7aca00ad-014d-4ccf-b973-54a3d8f6e222 tempest-GroupSnapshotsTest-1083032981 None] Create group completed successfully.
Sep 29 12:29:37 devstack sudo[95508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b682d7f-2d15-472e-b777-d4ae4fb98289
Sep 29 12:29:37 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:37 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b682d7f-2d15-472e-b777-d4ae4fb98289" returned: 0 in 0.471s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b682d7f-2d15-472e-b777-d4ae4fb98289 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:37 devstack sudo[95513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b682d7f-2d15-472e-b777-d4ae4fb98289
Sep 29 12:29:37 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:37 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b682d7f-2d15-472e-b777-d4ae4fb98289" returned: 0 in 0.267s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Lock "cinder-quobyte-2b682d7f-2d15-472e-b777-d4ae4fb98289" released by "delete_volume" :: held 0.817s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Created reservations ['ce29fd5f-018d-4375-b972-d59169def4fa', '35c70dbe-9ee8-441a-92fd-7ebb2659d09b', '86398269-86aa-405b-967d-9f2a2ce0512b', '57179c35-1af2-4838-869a-c220aa121746'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:37 devstack sudo[95516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:37 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:38 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.335s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Deleted volume successfully.
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-deea681f-1a73-49b4-96e1-c33eb2ead99e tempest-VolumesTestJSON-2126710872 None] Lock "cinder-2b682d7f-2d15-472e-b777-d4ae4fb98289-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Flow 'volume_create_manager' (22af6f03-4048-4d98-bdd8-e700d7380021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3b7016-2dc4-42b2-9a7e-a194fbf398aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3b7016-2dc4-42b2-9a7e-a194fbf398aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-122263993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b8336abc-c284-4220-a9a0-a7253ae8fe1e,host='devstack@QuobyteHD#QuobyteHD',id=ca81b8e8-73b1-40b4-85d4-93872a975e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61de0ea04c214c529d7f682095a41b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:39Z,use_quota=True,user_id='b0211da772814965a9dc0082504ded27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7bf54bc-beb1-4adf-beb9-06529357ab33),volume_type_id=d7bf54bc-beb1-4adf-beb9-06529357ab33)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c7ff78-ba49-4450-8ca5-ab8d62cb53e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c7ff78-ba49-4450-8ca5-ab8d62cb53e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc68e527-c385-4470-b7b0-ba4b4bd964f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc68e527-c385-4470-b7b0-ba4b4bd964f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca81b8e8-73b1-40b4-85d4-93872a975e51', 'volume_name': 'volume-ca81b8e8-73b1-40b4-85d4-93872a975e51', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6d79af-5586-4f91-9571-eda29a44a0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6d79af-5586-4f91-9571-eda29a44a0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4c71c4-0acf-4f1d-93b6-430931da11e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:38 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Volume ca81b8e8-73b1-40b4-85d4-93872a975e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca81b8e8-73b1-40b4-85d4-93872a975e51', 'volume_size': 1}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b8336abc-c284-4220-a9a0-a7253ae8fe1e,created_at=2026-09-29T10:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-122263993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b8336abc-c284-4220-a9a0-a7253ae8fe1e,host='devstack@QuobyteHD#QuobyteHD',id=ca81b8e8-73b1-40b4-85d4-93872a975e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61de0ea04c214c529d7f682095a41b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:39Z,use_quota=True,user_id='b0211da772814965a9dc0082504ded27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7bf54bc-beb1-4adf-beb9-06529357ab33),volume_type_id=d7bf54bc-beb1-4adf-beb9-06529357ab33)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Creating volume ca81b8e8-73b1-40b4-85d4-93872a975e51 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:29:38 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:29:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:38 devstack sudo[95519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 1073741824
Sep 29 12:29:38 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:39 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 1073741824" returned: 0 in 0.571s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:39 devstack sudo[95525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51
Sep 29 12:29:39 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:39 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:29:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4c71c4-0acf-4f1d-93b6-430931da11e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca81b8e8-73b1-40b4-85d4-93872a975e51', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a5f569-1d90-490f-a9b3-6f6303e789c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:39 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Volume volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 (ca81b8e8-73b1-40b4-85d4-93872a975e51): created successfully
Sep 29 12:29:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a5f569-1d90-490f-a9b3-6f6303e789c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Flow 'volume_create_manager' (22af6f03-4048-4d98-bdd8-e700d7380021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-96961e61-7f24-4fe1-962f-ecade7f55ae8 tempest-GroupSnapshotsTest-1083032981 None] Created volume successfully.
Sep 29 12:29:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] GroupSnapshot 3c286ca1-056b-4b7b-8f70-3b5e2ef75140: creating.
Sep 29 12:29:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] Group snapshot 3c286ca1-056b-4b7b-8f70-3b5e2ef75140: creating. {{(pid=86369) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 29 12:29:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] Creating offline snapshot 904c596e-a989-49ea-9cea-2eac15097ce6 of volume ca81b8e8-73b1-40b4-85d4-93872a975e51 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:29:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafa65d0-bd6e-43ab-8fcf-e53d099d4638]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:40 devstack sudo[95528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51
Sep 29 12:29:40 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:40 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51" returned: 0 in 0.474s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:40 devstack sudo[95533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6 1G
Sep 29 12:29:40 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:41 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6 1G" returned: 0 in 0.578s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:41 devstack sudo[95540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6
Sep 29 12:29:41 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:41 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6" returned: 0 in 0.415s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:41 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:29:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:41 devstack sudo[95546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6
Sep 29 12:29:41 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:42 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6" returned: 0 in 0.302s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:42 devstack sudo[95549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.info
Sep 29 12:29:42 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:42 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.info" returned: 0 in 0.261s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:42 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:29:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:42 devstack sudo[95552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.info
Sep 29 12:29:42 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:42 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.info" returned: 0 in 0.286s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f262f05d-296d-43e3-b2a4-9e730519d3c4 tempest-GroupSnapshotsTest-1083032981 None] group_snapshot 3c286ca1-056b-4b7b-8f70-3b5e2ef75140: created successfully
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-904c596e-a989-49ea-9cea-2eac15097ce6-0f51e537-a400-4af6-aa69-c45ef6e6be26" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-904c596e-a989-49ea-9cea-2eac15097ce6-0f51e537-a400-4af6-aa69-c45ef6e6be26" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Creating volume 0f51e537-a400-4af6-aa69-c45ef6e6be26 from snapshot 904c596e-a989-49ea-9cea-2eac15097ce6 {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-0f51e537-a400-4af6-aa69-c45ef6e6be26" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-0f51e537-a400-4af6-aa69-c45ef6e6be26" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] snapshot: 904c596e-a989-49ea-9cea-2eac15097ce6, volume: 0f51e537-a400-4af6-aa69-c45ef6e6be26,  {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cb99b5-b47a-4ba2-94e0-844987d08835]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:44 devstack sudo[95556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6
Sep 29 12:29:44 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:44 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6" returned: 0 in 0.453s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca81b8e8-73b1-40b4-85d4-93872a975e51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bddaf1-083b-4661-b5fb-30dabf46664f]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-046fbbca-5269-4092-a365-96cad6453e7f tempest-BackendsCapabilitiesAdminTestsJSON-1986979261 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0505638122559, 'free_capacity_gb': 1775.0505638122559, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86369) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b4c1b282-933e-4e45-b54c-96f3bb06525a tempest-BackendsCapabilitiesAdminTestsJSON-1986979261 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0505638122559, 'free_capacity_gb': 1775.0505638122559, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86369) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 29 12:29:45 devstack sudo[95561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51
Sep 29 12:29:45 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Flow 'volume_create_manager' (adb39e95-e021-48b9-8514-93d23b86caa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ac827a-fe93-4102-8d62-15f3ef0d9838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ac827a-fe93-4102-8d62-15f3ef0d9838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1036262208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb711165-9b8f-4dd1-b4be-435e7ab2a92a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4b978e0c2a415c9b1b8ef7a9d510a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:45Z,use_quota=True,user_id='2427d54bb7f54a86aec7504e4de11fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92c918d-3792-4eda-aeb2-f5d734f32429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92c918d-3792-4eda-aeb2-f5d734f32429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254da874-db57-44cf-849b-c1963c34841f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254da874-db57-44cf-849b-c1963c34841f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb711165-9b8f-4dd1-b4be-435e7ab2a92a', 'volume_name': 'volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43c6fd4-f97a-4d7f-a823-8404b3007c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43c6fd4-f97a-4d7f-a823-8404b3007c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a0d44c-9028-49b9-b898-122668e75075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:45 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Volume fb711165-9b8f-4dd1-b4be-435e7ab2a92a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a', 'volume_size': 1}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:45 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51" returned: 0 in 0.530s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Path /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 12:29:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:45 devstack sudo[95566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26
Sep 29 12:29:45 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=139,cinder:UPDATE=159,cinder:INSERT=32,cinder:DELETE=13 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=158,cinder:SELECT=115,cinder:DELETE=12,cinder:INSERT=40 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Flow 'volume_create_manager' (ac0702ae-1201-47db-bed4-ecfd7d492cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e07659e-a147-43be-8bd6-f958d13d675b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e07659e-a147-43be-8bd6-f958d13d675b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2090110948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb8ae52-2f7e-4fe8-81dd-ec73889d407d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba5d5804fb944d38d09449d6745ad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:50Z,use_quota=True,user_id='6307eb8579f1434d9c69b1a22f130733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1a1e82-4c05-4b56-8f82-08e9dc43f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1a1e82-4c05-4b56-8f82-08e9dc43f203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ffb5a5-520f-4775-be3d-55f4923cb776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ffb5a5-520f-4775-be3d-55f4923cb776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb8ae52-2f7e-4fe8-81dd-ec73889d407d', 'volume_name': 'volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40980485-b75c-4582-979b-a25e1f9bf7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40980485-b75c-4582-979b-a25e1f9bf7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2a1dbc-4ad0-4fe5-80f9-bbf3f4cfc1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Volume 9eb8ae52-2f7e-4fe8-81dd-ec73889d407d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d', 'volume_size': 1}
Sep 29 12:29:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:53 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26" returned: 0 in 7.945s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:29:53 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Converted 1024.00 MB image at 128.86 MB/s
Sep 29 12:29:53 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:53 devstack sudo[95628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26
Sep 29 12:29:53 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:53 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-0f51e537-a400-4af6-aa69-c45ef6e6be26" released by "_copy_volume_from_snapshot" :: held 9.341s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-904c596e-a989-49ea-9cea-2eac15097ce6-0f51e537-a400-4af6-aa69-c45ef6e6be26" released by "_create_volume_from_snapshot" :: held 9.441s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.471s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.300s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1036262208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb711165-9b8f-4dd1-b4be-435e7ab2a92a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4b978e0c2a415c9b1b8ef7a9d510a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:45Z,use_quota=True,user_id='2427d54bb7f54a86aec7504e4de11fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Creating volume fb711165-9b8f-4dd1-b4be-435e7ab2a92a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:29:53 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:29:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:53 devstack sudo[95632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a 1073741824
Sep 29 12:29:53 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b31c1493-3461-4d7c-ad02-12d35d99566f tempest-GroupSnapshotsTest-1083032981 None] Create group from source-snapshot-3c286ca1-056b-4b7b-8f70-3b5e2ef75140 completed successfully.
Sep 29 12:29:54 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a 1073741824" returned: 0 in 0.472s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:54 devstack sudo[95638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a
Sep 29 12:29:54 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:54 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.875s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2090110948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb8ae52-2f7e-4fe8-81dd-ec73889d407d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba5d5804fb944d38d09449d6745ad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:50Z,use_quota=True,user_id='6307eb8579f1434d9c69b1a22f130733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Creating volume 9eb8ae52-2f7e-4fe8-81dd-ec73889d407d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:29:54 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a0d44c-9028-49b9-b898-122668e75075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:54 devstack sudo[95641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d 1073741824
Sep 29 12:29:54 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca1a9a9-5d34-47d6-8112-bcd0ae77fa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:54 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Volume volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a (fb711165-9b8f-4dd1-b4be-435e7ab2a92a): created successfully
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca1a9a9-5d34-47d6-8112-bcd0ae77fa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Flow 'volume_create_manager' (adb39e95-e021-48b9-8514-93d23b86caa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7327f9e9-aee3-47d1-a51e-e6f53715229e tempest-VolumesMetadataTest-907998510 None] Created volume successfully.
Sep 29 12:29:55 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d 1073741824" returned: 0 in 0.504s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:55 devstack sudo[95647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d
Sep 29 12:29:55 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:55 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d" returned: 0 in 0.286s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-0f51e537-a400-4af6-aa69-c45ef6e6be26" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2a1dbc-4ad0-4fe5-80f9-bbf3f4cfc1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2edcae-190e-4b32-af15-deba9985f3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-0f51e537-a400-4af6-aa69-c45ef6e6be26" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:55 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Volume volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d (9eb8ae52-2f7e-4fe8-81dd-ec73889d407d): created successfully
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2edcae-190e-4b32-af15-deba9985f3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Flow 'volume_create_manager' (ac0702ae-1201-47db-bed4-ecfd7d492cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[01851f8f-f0e9-4f59-9101-d29936a0f6c3]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c23c8f32-5c27-4741-a881-80d3f6d09984 tempest-VolumeQuotasAdminTestJSON-448036150 None] Created volume successfully.
Sep 29 12:29:55 devstack sudo[95650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26
Sep 29 12:29:55 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:55 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26" returned: 0 in 0.453s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:56 devstack sudo[95661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26
Sep 29 12:29:56 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:56 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0f51e537-a400-4af6-aa69-c45ef6e6be26" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-0f51e537-a400-4af6-aa69-c45ef6e6be26" released by "delete_volume" :: held 0.807s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Acquiring lock "cinder-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "cinder-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['63da5708-6e71-4fe4-9301-e6e28ce41f8e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Acquiring lock "cinder-quobyte-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:56 devstack cinder-volume[86369]: WARNING cinder.quota [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1289201901 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1289201901, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:29:56 devstack cinder-volume[86369]: WARNING cinder.quota [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1289201901 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1289201901, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "cinder-quobyte-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['aa107829-7e53-44fb-8167-8b8fff6deba0', '67f196e4-dc69-4c6e-84bb-6d6d19876bdc', '62b9b49e-ba04-4115-b0b9-f5f25199e006', '47da1c56-5ff2-4e3f-ac27-922b41108adc'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16fa3de-04d9-4087-a26b-72a7e50ba5a3]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:56 devstack sudo[95664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d
Sep 29 12:29:56 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:56 devstack sudo[95666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:56 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] group_snapshot 3c286ca1-056b-4b7b-8f70-3b5e2ef75140: deleting
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] group_snapshot 3c286ca1-056b-4b7b-8f70-3b5e2ef75140: deleting {{(pid=86369) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 29 12:29:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-ca81b8e8-73b1-40b4-85d4-93872a975e51" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-ca81b8e8-73b1-40b4-85d4-93872a975e51" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-904c596e-a989-49ea-9cea-2eac15097ce6" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:57 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-904c596e-a989-49ea-9cea-2eac15097ce6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Deleting offline snapshot 904c596e-a989-49ea-9cea-2eac15097ce6 of volume ca81b8e8-73b1-40b4-85d4-93872a975e51 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:29:57 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] snapshot_file for this snap is: volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.386s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d" returned: 0 in 0.568s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df9f81d-23a4-4b8c-a539-c99e52f87145]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Acquiring lock "cinder-fb711165-9b8f-4dd1-b4be-435e7ab2a92a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2e577fc3-d67d-4e83-a33c-62ac4a9b69ed tempest-GroupSnapshotsTest-1083032981 None] Delete group completed successfully.
Sep 29 12:29:57 devstack sudo[95672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d
Sep 29 12:29:57 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Lock "cinder-fb711165-9b8f-4dd1-b4be-435e7ab2a92a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Acquiring lock "cinder-quobyte-fb711165-9b8f-4dd1-b4be-435e7ab2a92a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Lock "cinder-quobyte-fb711165-9b8f-4dd1-b4be-435e7ab2a92a" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:29:57 devstack sudo[95673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2b5810-34b7-477c-87e7-5307c86c37c9]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:57 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:57 devstack sudo[95676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a
Sep 29 12:29:57 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:57 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d" returned: 0 in 0.457s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "cinder-quobyte-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d" released by "delete_volume" :: held 1.090s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Created reservations ['94be2555-060e-4465-b4e0-09d65944c583', '2471a696-c6b6-4ae3-a623-f25e660821ab', '3bb68290-6c23-4543-9027-7b4c7825bf43', '09285623-3056-4410-a53a-fce5fe68ddc6'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:57 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6" returned: 0 in 0.557s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca81b8e8-73b1-40b4-85d4-93872a975e51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d635c6-c8f1-4c1b-9526-ed1b737c1f8c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:57 devstack sudo[95686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:57 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:57 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a" returned: 0 in 0.522s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:57 devstack sudo[95683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51
Sep 29 12:29:57 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:57 devstack sudo[95691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a
Sep 29 12:29:57 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:58 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Deleted volume successfully.
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-631516b0-1084-4b08-816c-b9e86cf9cc62 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "cinder-9eb8ae52-2f7e-4fe8-81dd-ec73889d407d-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:58 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb711165-9b8f-4dd1-b4be-435e7ab2a92a" returned: 0 in 0.312s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Lock "cinder-quobyte-fb711165-9b8f-4dd1-b4be-435e7ab2a92a" released by "delete_volume" :: held 0.937s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Created reservations ['bdb35847-bde1-4122-b018-9c29c7ca10f5', '0ac42853-ede5-4288-a039-ece38195f487', 'b091ded8-3d92-40fe-8895-d1fcaa943af8', 'e78298cb-88d3-4c16-bca4-423f32c54373'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:58 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51" returned: 0 in 0.667s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:58 devstack sudo[95698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:29:58 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:58 devstack sudo[95699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6
Sep 29 12:29:58 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:58 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.391s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:29:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Deleted volume successfully.
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-abb8b829-a76a-4a8e-b862-8e32a4cb5361 tempest-VolumesMetadataTest-907998510 None] Lock "cinder-fb711165-9b8f-4dd1-b4be-435e7ab2a92a-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:58 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6" returned: 0 in 0.503s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:58 devstack sudo[95706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6
Sep 29 12:29:58 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:59 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51.904c596e-a989-49ea-9cea-2eac15097ce6" returned: 0 in 0.414s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-904c596e-a989-49ea-9cea-2eac15097ce6" released by "_delete_snapshot" :: held 2.353s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-ca81b8e8-73b1-40b4-85d4-93872a975e51" released by "delete_snapshot" :: held 2.386s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Flow 'volume_create_manager' (19dd7ca3-a32b-4213-b418-3f9d8d427fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85644e85-c789-4922-9bc9-364035c9a3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85644e85-c789-4922-9bc9-364035c9a3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1532786761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba5d5804fb944d38d09449d6745ad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:59Z,use_quota=True,user_id='6307eb8579f1434d9c69b1a22f130733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0198776c-8834-4ac9-a12a-ab27b5080c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0198776c-8834-4ac9-a12a-ab27b5080c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1c8d09-8828-4282-b97c-e0b644ee0eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1c8d09-8828-4282-b97c-e0b644ee0eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9', 'volume_name': 'volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf535c87-f506-42f8-b3f0-dcd6f5206233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf535c87-f506-42f8-b3f0-dcd6f5206233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74c1592-adeb-4536-b3c3-fbc7f5c05deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:29:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Volume 7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9', 'volume_size': 1}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1532786761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba5d5804fb944d38d09449d6745ad89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:29:59Z,use_quota=True,user_id='6307eb8579f1434d9c69b1a22f130733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Creating volume 7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:29:59 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:29:59 devstack sudo[95709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9 1073741824
Sep 29 12:29:59 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:29:59 devstack cinder-volume[86369]: WARNING cinder.quota [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1289201901 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1289201901, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:29:59 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['9714a80b-ec44-477b-9f45-3f48436080bb', 'c6555d84-c638-4266-9775-cc129ddd15d8', '9ccf8137-16e8-47ba-b9ea-565f133bdd4a', '08f0ce83-faa1-4107-9570-3105159fd3ee'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:29:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e49c0156-d805-40b2-a28d-04bc1c999c18 tempest-GroupSnapshotsTest-1083032981 None] group_snapshot 3c286ca1-056b-4b7b-8f70-3b5e2ef75140: deleted successfully
Sep 29 12:30:00 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9 1073741824" returned: 0 in 0.531s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:00 devstack sudo[95715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9
Sep 29 12:30:00 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:00 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9" returned: 0 in 0.314s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74c1592-adeb-4536-b3c3-fbc7f5c05deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adee5c87-bd2c-4eb8-9a9d-d410b9724666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:00 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Volume volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9 (7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9): created successfully
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adee5c87-bd2c-4eb8-9a9d-d410b9724666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Flow 'volume_create_manager' (19dd7ca3-a32b-4213-b418-3f9d8d427fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:00 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ba5cca30-d983-416f-9c56-a791cf980e15 tempest-VolumeQuotasAdminTestJSON-448036150 None] Created volume successfully.
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-ca81b8e8-73b1-40b4-85d4-93872a975e51" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-ca81b8e8-73b1-40b4-85d4-93872a975e51" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1809f0ff-dead-4ba9-bd46-e575405bc18e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:01 devstack sudo[95718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51
Sep 29 12:30:01 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:01 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51" returned: 0 in 0.466s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:01 devstack sudo[95723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51
Sep 29 12:30:01 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:01 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ca81b8e8-73b1-40b4-85d4-93872a975e51" returned: 0 in 0.344s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-ca81b8e8-73b1-40b4-85d4-93872a975e51" released by "delete_volume" :: held 0.918s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:01 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['3554463e-1c03-4d9c-b4e3-216690c71375'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:01 devstack cinder-volume[86369]: WARNING cinder.db.api [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1289201901']
Sep 29 12:30:01 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['51fce66a-092a-4486-9e17-7946f35249fe', '7727f185-7340-49a1-8370-c578def5ac19', 'e765f05a-5c64-4c84-a083-532afd7153ae', 'ebeddb63-0168-44ec-b8ed-447264b4bb38'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:02 devstack sudo[95726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:30:02 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:02 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.289s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:02 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:30:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f1080056-4bd7-430d-a600-1fca93b0e4d4 tempest-GroupSnapshotsTest-1083032981 None] Delete group completed successfully.
Sep 29 12:30:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e7cbf926-b938-4980-a01b-bfc3dbaa35bd tempest-VolumeQuotasAdminTestJSON-1263616807 None] Transfer volume completed successfully.
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Flow 'volume_create_manager' (962b40dc-390c-4462-882e-593d377c74bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f53cfa0-63d2-4a19-bb5f-12b81d194274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f53cfa0-63d2-4a19-bb5f-12b81d194274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-27747110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc221a6-f8c5-4926-a989-8fb6edc5cb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b5ec254d64e89bcf53b57ec9963a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:03Z,use_quota=True,user_id='fb347b38194243a8b3cee71f75431969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90538387-510b-4bb2-82f0-1d98141aa1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90538387-510b-4bb2-82f0-1d98141aa1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d83bde5-a54f-4617-b7d6-7588a642fe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d83bde5-a54f-4617-b7d6-7588a642fe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc221a6-f8c5-4926-a989-8fb6edc5cb6e', 'volume_name': 'volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333e22d8-6dd5-4934-8d59-21dbd1325ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333e22d8-6dd5-4934-8d59-21dbd1325ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43592a57-5168-421c-b106-1d987f5f0759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:03 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Volume 9dc221a6-f8c5-4926-a989-8fb6edc5cb6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e', 'volume_size': 1}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-27747110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc221a6-f8c5-4926-a989-8fb6edc5cb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679b5ec254d64e89bcf53b57ec9963a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:03Z,use_quota=True,user_id='fb347b38194243a8b3cee71f75431969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Creating volume 9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:30:03 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Acquiring lock "cinder-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:03 devstack sudo[95730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e 1073741824
Sep 29 12:30:03 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Lock "cinder-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Flow 'volume_create_manager' (202cfe6e-2af6-4c95-b8b3-cdf84def5c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b868d4de-65f2-41db-8ea6-03376ca78569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Acquiring lock "cinder-quobyte-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b868d4de-65f2-41db-8ea6-03376ca78569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1314495866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d3827b-4dc0-42d6-b058-c8ff73006ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5877e1b729f4cc782e344c978350393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:04Z,use_quota=True,user_id='30fe0643b85c41aa8dd0beb4011ea048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a33fd4e-c104-4e69-9a28-87e0aa420914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a33fd4e-c104-4e69-9a28-87e0aa420914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3716df54-e029-4d59-b9f9-7549c6f9b285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3716df54-e029-4d59-b9f9-7549c6f9b285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d3827b-4dc0-42d6-b058-c8ff73006ead', 'volume_name': 'volume-47d3827b-4dc0-42d6-b058-c8ff73006ead', 'volume_size': 2}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eae27cd-65c5-4456-b5b2-585041834744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eae27cd-65c5-4456-b5b2-585041834744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6001d55-3d36-4b8a-bc4c-b2734af52ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:03 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Volume 47d3827b-4dc0-42d6-b058-c8ff73006ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d3827b-4dc0-42d6-b058-c8ff73006ead', 'volume_size': 2}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Lock "cinder-quobyte-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9" acquired by "delete_volume" :: waited 0.077s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7be53c-0715-415f-adbc-e2a7e5ba739f]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7c747279-3139-4624-ad38-63c6672fce5d tempest-GroupSnapshotsTest-1083032981 None] Group tempest-GroupSnapshotsTest-Group-1321959053: creating
Sep 29 12:30:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7c747279-3139-4624-ad38-63c6672fce5d tempest-GroupSnapshotsTest-1083032981 None] Group tempest-GroupSnapshotsTest-Group-1321959053: created successfully
Sep 29 12:30:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7c747279-3139-4624-ad38-63c6672fce5d tempest-GroupSnapshotsTest-1083032981 None] Create group completed successfully.
Sep 29 12:30:03 devstack sudo[95732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9
Sep 29 12:30:03 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:04 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e 1073741824" returned: 0 in 0.521s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:04 devstack sudo[95739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e
Sep 29 12:30:04 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:04 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9" returned: 0 in 0.405s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:04 devstack sudo[95744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9
Sep 29 12:30:04 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:04 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.640s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1314495866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d3827b-4dc0-42d6-b058-c8ff73006ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5877e1b729f4cc782e344c978350393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:04Z,use_quota=True,user_id='30fe0643b85c41aa8dd0beb4011ea048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Creating volume 47d3827b-4dc0-42d6-b058-c8ff73006ead {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:30:04 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-47d3827b-4dc0-42d6-b058-c8ff73006ead 2147483648 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43592a57-5168-421c-b106-1d987f5f0759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:04 devstack sudo[95747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-47d3827b-4dc0-42d6-b058-c8ff73006ead 2147483648
Sep 29 12:30:04 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7707f066-dda0-4abe-b77c-a55b4357991b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Volume volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e (9dc221a6-f8c5-4926-a989-8fb6edc5cb6e): created successfully
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7707f066-dda0-4abe-b77c-a55b4357991b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Flow 'volume_create_manager' (962b40dc-390c-4462-882e-593d377c74bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-37ad85ad-a0d6-48d2-9735-6d6fc68cd0ac tempest-SnapshotsActionsTest-1206955278 None] Created volume successfully.
Sep 29 12:30:04 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Lock "cinder-quobyte-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9" released by "delete_volume" :: held 0.750s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Created reservations ['6df649f3-8b06-42e2-9e48-48836871df00', 'c2740526-d576-4a2f-bd6a-8510bac90922', '6b38396c-8f26-4e77-9a5e-3df1671d69d4', '0bca15b2-42b7-4645-804c-bad0d6363acb'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:04 devstack sudo[95752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:30:04 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:04 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:30:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Deleted volume successfully.
Sep 29 12:30:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2e8aed1b-5756-40a2-a4b3-3370074968c6 tempest-VolumeQuotasAdminTestJSON-331302037 None] Lock "cinder-7c3e0d1d-29dd-4550-9f8d-e4dda4b0efd9-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:05 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-47d3827b-4dc0-42d6-b058-c8ff73006ead 2147483648" returned: 0 in 0.617s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-47d3827b-4dc0-42d6-b058-c8ff73006ead {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:05 devstack sudo[95757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-47d3827b-4dc0-42d6-b058-c8ff73006ead
Sep 29 12:30:05 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:05 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-47d3827b-4dc0-42d6-b058-c8ff73006ead" returned: 0 in 0.298s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6001d55-3d36-4b8a-bc4c-b2734af52ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d3827b-4dc0-42d6-b058-c8ff73006ead', 'volume_size': 2}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24f0010-a81a-413e-9623-e18b6a96d4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Volume volume-47d3827b-4dc0-42d6-b058-c8ff73006ead (47d3827b-4dc0-42d6-b058-c8ff73006ead): created successfully
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24f0010-a81a-413e-9623-e18b6a96d4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Flow 'volume_create_manager' (202cfe6e-2af6-4c95-b8b3-cdf84def5c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5e827c3e-46ee-44ee-b157-952450a89585 tempest-VolumesCloneNegativeTest-1504576683 None] Created volume successfully.
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Flow 'volume_create_manager' (2d061691-75f6-483c-8ac4-56cecb2f4ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95e8547-a4f4-40d4-a7da-2112164fb0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95e8547-a4f4-40d4-a7da-2112164fb0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142108086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9eb01b26-2c18-4562-8623-5708c0637aae,host='devstack@QuobyteHD#QuobyteHD',id=ada36f40-e5bf-448e-8e4b-66c974787f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61de0ea04c214c529d7f682095a41b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:06Z,use_quota=True,user_id='b0211da772814965a9dc0082504ded27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4397fdce-e776-4325-b6ff-7225784e035c),volume_type_id=4397fdce-e776-4325-b6ff-7225784e035c)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4dc08f-da68-4e5a-90a2-79faeda5f1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4dc08f-da68-4e5a-90a2-79faeda5f1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d12942-c11a-4cf9-84ed-652d0567974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d12942-c11a-4cf9-84ed-652d0567974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada36f40-e5bf-448e-8e4b-66c974787f6b', 'volume_name': 'volume-ada36f40-e5bf-448e-8e4b-66c974787f6b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d14ee0-3dbf-4c42-97da-140ae275e8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d14ee0-3dbf-4c42-97da-140ae275e8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c803547-3f07-42d2-bae4-7e358cb24f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Volume ada36f40-e5bf-448e-8e4b-66c974787f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada36f40-e5bf-448e-8e4b-66c974787f6b', 'volume_size': 1}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9eb01b26-2c18-4562-8623-5708c0637aae,created_at=2026-09-29T10:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142108086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9eb01b26-2c18-4562-8623-5708c0637aae,host='devstack@QuobyteHD#QuobyteHD',id=ada36f40-e5bf-448e-8e4b-66c974787f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61de0ea04c214c529d7f682095a41b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:06Z,use_quota=True,user_id='b0211da772814965a9dc0082504ded27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4397fdce-e776-4325-b6ff-7225784e035c),volume_type_id=4397fdce-e776-4325-b6ff-7225784e035c)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Creating volume ada36f40-e5bf-448e-8e4b-66c974787f6b {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:30:05 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:05 devstack sudo[95761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b 1073741824
Sep 29 12:30:05 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Acquiring lock "cinder-47d3827b-4dc0-42d6-b058-c8ff73006ead-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Lock "cinder-47d3827b-4dc0-42d6-b058-c8ff73006ead-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Acquiring lock "cinder-quobyte-47d3827b-4dc0-42d6-b058-c8ff73006ead" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Lock "cinder-quobyte-47d3827b-4dc0-42d6-b058-c8ff73006ead" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[821b6680-f421-45b4-bd5a-ea3b493176f5]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-47d3827b-4dc0-42d6-b058-c8ff73006ead {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:06 devstack sudo[95766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-47d3827b-4dc0-42d6-b058-c8ff73006ead
Sep 29 12:30:06 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:06 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b 1073741824" returned: 0 in 0.568s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:06 devstack sudo[95769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b
Sep 29 12:30:06 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:06 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-47d3827b-4dc0-42d6-b058-c8ff73006ead" returned: 0 in 0.442s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-47d3827b-4dc0-42d6-b058-c8ff73006ead {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:06 devstack sudo[95774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-47d3827b-4dc0-42d6-b058-c8ff73006ead
Sep 29 12:30:06 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:06 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b" returned: 0 in 0.285s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.842s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c803547-3f07-42d2-bae4-7e358cb24f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada36f40-e5bf-448e-8e4b-66c974787f6b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ceab9c5-5eeb-4395-85fe-e82f62f3b407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] Creating offline snapshot becc3b0a-c0c5-4e0e-9387-38b89df130ca of volume 9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:30:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Volume volume-ada36f40-e5bf-448e-8e4b-66c974787f6b (ada36f40-e5bf-448e-8e4b-66c974787f6b): created successfully
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ceab9c5-5eeb-4395-85fe-e82f62f3b407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Flow 'volume_create_manager' (2d061691-75f6-483c-8ac4-56cecb2f4ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dca724-57c1-4a63-af77-69b9fa95a501]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-57bddbcf-890a-478a-a499-a9b713378ad4 tempest-GroupSnapshotsTest-1083032981 None] Created volume successfully.
Sep 29 12:30:06 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-47d3827b-4dc0-42d6-b058-c8ff73006ead" returned: 0 in 0.299s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Lock "cinder-quobyte-47d3827b-4dc0-42d6-b058-c8ff73006ead" released by "delete_volume" :: held 0.812s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:06 devstack sudo[95778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e
Sep 29 12:30:06 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:06 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Created reservations ['47ef0411-be88-410e-afba-36994d9b29b3', '1fa0adaf-089d-4a46-b044-a49bafb24fbc', '889e0033-2abf-4fa7-9b85-2da6b7f50529', 'bca11761-1be4-444c-aa8f-e2695bac3079'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:07 devstack sudo[95780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:30:07 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:07 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" returned: 0 in 0.618s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:07 devstack sudo[95785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca 1G
Sep 29 12:30:07 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:07 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.449s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:30:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Deleted volume successfully.
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-91e85071-8d23-47cd-be25-49e28273c4f8 tempest-VolumesCloneNegativeTest-1504576683 None] Lock "cinder-47d3827b-4dc0-42d6-b058-c8ff73006ead-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:07 devstack sudo[95793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:30:07 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:30:08 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Flow 'volume_create_manager' (8db82af0-400d-45cb-aab2-fee63356938f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9c6f0e-f35f-436f-8fdd-c02408b3ecce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca 1G" returned: 0 in 0.731s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9c6f0e-f35f-436f-8fdd-c02408b3ecce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-186290401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9eb01b26-2c18-4562-8623-5708c0637aae,host='devstack@QuobyteHD#QuobyteHD',id=f2b487c1-653e-46eb-8388-77b4f4371481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61de0ea04c214c529d7f682095a41b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:08Z,use_quota=True,user_id='b0211da772814965a9dc0082504ded27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4397fdce-e776-4325-b6ff-7225784e035c),volume_type_id=4397fdce-e776-4325-b6ff-7225784e035c)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:08 devstack sudo[95796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:08 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51d7c25-ca0b-4667-b42b-8a1ac4ea15ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51d7c25-ca0b-4667-b42b-8a1ac4ea15ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5305a6b2-a4fa-40f7-ba77-143dfead19ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5305a6b2-a4fa-40f7-ba77-143dfead19ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b487c1-653e-46eb-8388-77b4f4371481', 'volume_name': 'volume-f2b487c1-653e-46eb-8388-77b4f4371481', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b189e38-a93c-45d6-b7a0-cdaff0c4ddf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b189e38-a93c-45d6-b7a0-cdaff0c4ddf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868bbf94-5981-4a26-8c25-262574cbb1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:08 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Volume f2b487c1-653e-46eb-8388-77b4f4371481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b487c1-653e-46eb-8388-77b4f4371481', 'volume_size': 1}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:08 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.475s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:30:08 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.412s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:08 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca is being set with open permissions: ugo+rw
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:08 devstack sudo[95803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:08 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:08 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.311s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:08 devstack sudo[95806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.info
Sep 29 12:30:08 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:09 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.info" returned: 0 in 0.291s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:09 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.info is being set with open permissions: ugo+rw
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:09 devstack sudo[95809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.info
Sep 29 12:30:09 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:09 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.info" returned: 0 in 0.335s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.857s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.315s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9eb01b26-2c18-4562-8623-5708c0637aae,created_at=2026-09-29T10:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-186290401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9eb01b26-2c18-4562-8623-5708c0637aae,host='devstack@QuobyteHD#QuobyteHD',id=f2b487c1-653e-46eb-8388-77b4f4371481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61de0ea04c214c529d7f682095a41b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:08Z,use_quota=True,user_id='b0211da772814965a9dc0082504ded27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4397fdce-e776-4325-b6ff-7225784e035c),volume_type_id=4397fdce-e776-4325-b6ff-7225784e035c)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Creating volume f2b487c1-653e-46eb-8388-77b4f4371481 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:30:09 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:30:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:09 devstack sudo[95812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481 1073741824
Sep 29 12:30:09 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-326c48bf-e6f4-4a59-9833-abc799c55e95 tempest-SnapshotsActionsTest-1206955278 None] Create snapshot completed successfully
Sep 29 12:30:10 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481 1073741824" returned: 0 in 0.614s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:10 devstack sudo[95818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481
Sep 29 12:30:10 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:10 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481" returned: 0 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:30:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868bbf94-5981-4a26-8c25-262574cbb1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b487c1-653e-46eb-8388-77b4f4371481', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb47ac00-30cd-49b0-a033-b02f81af2e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:10 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Volume volume-f2b487c1-653e-46eb-8388-77b4f4371481 (f2b487c1-653e-46eb-8388-77b4f4371481): created successfully
Sep 29 12:30:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb47ac00-30cd-49b0-a033-b02f81af2e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Flow 'volume_create_manager' (8db82af0-400d-45cb-aab2-fee63356938f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-38a694cb-23fd-4ea9-ae46-cca5b48ce88e tempest-GroupSnapshotsTest-1083032981 None] Created volume successfully.
Sep 29 12:30:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] Creating offline snapshot 8319af34-59f9-4994-b8d3-e77d0cbc3796 of volume 9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:30:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45698ec-0fe1-4826-b7fe-95a12afb4f25]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:11 devstack sudo[95825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:11 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:11 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.393s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:11 devstack sudo[95830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796 1G
Sep 29 12:30:11 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-de0d1c91-d543-4494-9bac-192e69e6418b tempest-GroupSnapshotsTest-1083032981 None] Update group completed successfully.
Sep 29 12:30:12 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796 1G" returned: 0 in 0.695s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:12 devstack sudo[95836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796
Sep 29 12:30:12 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:12 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796" returned: 0 in 0.357s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:12 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796 is being set with open permissions: ugo+rw
Sep 29 12:30:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:12 devstack sudo[95841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796
Sep 29 12:30:12 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:13 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796" returned: 0 in 0.287s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-32029782-636d-4870-8d3d-b722a61a37ce tempest-SnapshotsActionsTest-1206955278 None] Create snapshot completed successfully
Sep 29 12:30:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8b89d7a6-1847-46fb-8999-40cf5a1cde11 tempest-GroupSnapshotsTest-1083032981 None] Update group completed successfully.
Sep 29 12:30:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Acquiring lock "cinder-8319af34-59f9-4994-b8d3-e77d0cbc3796-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-8319af34-59f9-4994-b8d3-e77d0cbc3796-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Acquiring lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Acquiring lock "cinder-quobyte-8319af34-59f9-4994-b8d3-e77d0cbc3796" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-8319af34-59f9-4994-b8d3-e77d0cbc3796" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Deleting offline snapshot 8319af34-59f9-4994-b8d3-e77d0cbc3796 of volume 9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:30:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] snapshot_file for this snap is: volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:30:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e5730a-e230-43b3-99dc-020e7d9fc83c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:13 devstack sudo[95844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796
Sep 29 12:30:13 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:14 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796" returned: 0 in 0.448s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[24495c84-3e92-4164-b4ec-d409df3b15c0]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:14 devstack sudo[95850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:14 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:14 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.477s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e8807543-dd03-4ab0-8000-faf93f8be0f3 tempest-GroupSnapshotsTest-1083032981 None] Update group completed successfully.
Sep 29 12:30:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:14 devstack sudo[95855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796
Sep 29 12:30:14 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:15 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796" returned: 0 in 0.467s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:15 devstack sudo[95861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796
Sep 29 12:30:15 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:15 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.8319af34-59f9-4994-b8d3-e77d0cbc3796" returned: 0 in 0.312s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-8319af34-59f9-4994-b8d3-e77d0cbc3796" released by "_delete_snapshot" :: held 1.851s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" released by "delete_snapshot" :: held 1.876s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:15 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Created reservations ['d99a1057-ed02-4580-b0b8-e09e79a456a6', 'db150387-2887-46f2-a2e2-13deff45daf1', 'e85cabb0-9f67-4a9d-9acc-c2eb30380204', 'fbebe0ca-1294-4cc6-a980-55dc5eed66f2'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Delete snapshot completed successfully.
Sep 29 12:30:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-07a10764-e9dd-4e5e-843b-237fbe81d8c6 tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-8319af34-59f9-4994-b8d3-e77d0cbc3796-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-09477b45-5fea-48a2-ad09-8fd2ee58f588 tempest-GroupSnapshotsTest-1083032981 None] Update group completed successfully.
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Flow 'volume_create_manager' (ba79c743-56f0-44fa-b302-ff6471b7d945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ceeab4-cccf-415a-8aa3-49bf7cfdf78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ceeab4-cccf-415a-8aa3-49bf7cfdf78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-934641318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c3d071-17aa-49a2-8c2d-0e96f38bfe00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6479ddbc3d464445b2fc4f013654d5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:16Z,use_quota=True,user_id='f9622dda2d904e1ba2205aa03244d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12610ee1-bd15-4cc9-b798-18cc3508f290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12610ee1-bd15-4cc9-b798-18cc3508f290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718dbf10-e01e-4aa6-b730-85b213ce759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718dbf10-e01e-4aa6-b730-85b213ce759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c3d071-17aa-49a2-8c2d-0e96f38bfe00', 'volume_name': 'volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d64cb4-70de-46ae-acb5-bccaca69788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d64cb4-70de-46ae-acb5-bccaca69788f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6a2bb0-7d1f-4570-805d-e5d50926d309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:16 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Volume d8c3d071-17aa-49a2-8c2d-0e96f38bfe00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00', 'volume_size': 1}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-934641318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c3d071-17aa-49a2-8c2d-0e96f38bfe00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6479ddbc3d464445b2fc4f013654d5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:16Z,use_quota=True,user_id='f9622dda2d904e1ba2205aa03244d7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Creating volume d8c3d071-17aa-49a2-8c2d-0e96f38bfe00 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:30:16 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:16 devstack sudo[95864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00 1073741824
Sep 29 12:30:16 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] GroupSnapshot db21f81e-11da-4784-94e0-0a84640239f4: creating.
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Group snapshot db21f81e-11da-4784-94e0-0a84640239f4: creating. {{(pid=86369) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:16 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00 1073741824" returned: 0 in 0.512s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:16 devstack sudo[95870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00
Sep 29 12:30:16 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:17 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00" returned: 0 in 0.291s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.802s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6a2bb0-7d1f-4570-805d-e5d50926d309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc8c3e6-3a80-4e51-852d-a4fd8197cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] Creating offline snapshot 58e2c22f-2fa2-48d8-8628-98c684f0251e of volume 9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:30:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Volume volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00 (d8c3d071-17aa-49a2-8c2d-0e96f38bfe00): created successfully
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc8c3e6-3a80-4e51-852d-a4fd8197cc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Flow 'volume_create_manager' (ba79c743-56f0-44fa-b302-ff6471b7d945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8c3e4d-5af8-4c0c-b415-cca77db6fd64]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6ca9a05a-87f6-4209-8fa0-4b1e3cb39983 tempest-VolumesNegativeTest-1222720730 None] Created volume successfully.
Sep 29 12:30:17 devstack sudo[95873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:17 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:17 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.423s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:17 devstack sudo[95879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e 1G
Sep 29 12:30:17 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:18 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e 1G" returned: 0 in 0.541s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:18 devstack sudo[95885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e
Sep 29 12:30:18 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:18 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e" returned: 0 in 0.418s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:18 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e is being set with open permissions: ugo+rw
Sep 29 12:30:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:18 devstack sudo[95891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e
Sep 29 12:30:18 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:18 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.416s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Creating offline snapshot 5cdecabf-9fc2-4ff4-a7a3-158028fa1700 of volume f2b487c1-653e-46eb-8388-77b4f4371481 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:30:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-36cc2867-1f5d-4db7-98d6-a9d1142c936e tempest-SnapshotsActionsTest-1206955278 None] Create snapshot completed successfully
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b271d75-38bd-4e44-9528-ef49d163d897]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:19 devstack sudo[95897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481
Sep 29 12:30:19 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:19 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481" returned: 0 in 0.456s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:19 devstack sudo[95902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700 1G
Sep 29 12:30:19 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Acquiring lock "cinder-58e2c22f-2fa2-48d8-8628-98c684f0251e-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-58e2c22f-2fa2-48d8-8628-98c684f0251e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Acquiring lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Acquiring lock "cinder-quobyte-58e2c22f-2fa2-48d8-8628-98c684f0251e" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-58e2c22f-2fa2-48d8-8628-98c684f0251e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Deleting offline snapshot 58e2c22f-2fa2-48d8-8628-98c684f0251e of volume 9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] snapshot_file for this snap is: volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf73311-00f8-40d5-842f-719323ae2bee]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:20 devstack sudo[95906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e
Sep 29 12:30:20 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:20 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700 1G" returned: 0 in 0.646s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b487c1-653e-46eb-8388-77b4f4371481 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:20 devstack sudo[95910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b487c1-653e-46eb-8388-77b4f4371481 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700
Sep 29 12:30:20 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:20 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e" returned: 0 in 0.559s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e1bf67-912d-47cd-a98d-9e6d472a95da]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:20 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b487c1-653e-46eb-8388-77b4f4371481 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700" returned: 0 in 0.493s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:20 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:30:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:20 devstack sudo[95917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:20 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:20 devstack sudo[95919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700
Sep 29 12:30:20 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:21 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700" returned: 0 in 0.387s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:21 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.607s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:21 devstack sudo[95931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.info
Sep 29 12:30:21 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:21 devstack sudo[95932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e
Sep 29 12:30:21 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:21 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.info" returned: 0 in 0.363s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:21 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:21 devstack sudo[95942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.info
Sep 29 12:30:21 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:21 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e" returned: 0 in 0.696s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:21 devstack sudo[95953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e
Sep 29 12:30:21 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:21 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.info" returned: 0 in 0.406s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.909s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Creating offline snapshot f27f65c9-bbb2-4992-97fb-e6df86d8bd6c of volume ada36f40-e5bf-448e-8e4b-66c974787f6b {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[368762df-eff7-4b0c-bb6d-0a85bbc24284]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:22 devstack sudo[95955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b
Sep 29 12:30:22 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:22 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.58e2c22f-2fa2-48d8-8628-98c684f0251e" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-58e2c22f-2fa2-48d8-8628-98c684f0251e" released by "_delete_snapshot" :: held 2.362s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" released by "delete_snapshot" :: held 2.399s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:22 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Created reservations ['80aa7f33-e2d9-4488-b9cd-c16f83fa4db5', '0a85a5e1-366f-4de8-becd-8184b59ab50f', '2ac8f861-613e-4370-98c1-bd83fc6e3d44', '47ba1c51-6850-4a05-b513-29167d479e65'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Delete snapshot completed successfully.
Sep 29 12:30:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0bc0ecfc-7c43-43c0-99d7-a195b71319b6 tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-58e2c22f-2fa2-48d8-8628-98c684f0251e-delete_snapshot" released by "delete_snapshot" :: held 2.605s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:22 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b" returned: 0 in 0.456s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:22 devstack sudo[95961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c 1G
Sep 29 12:30:22 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:22 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c 1G" returned: 0 in 0.532s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ada36f40-e5bf-448e-8e4b-66c974787f6b -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:22 devstack sudo[95967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ada36f40-e5bf-448e-8e4b-66c974787f6b -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c
Sep 29 12:30:22 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Flow 'volume_create_manager' (0fb2d376-a788-4c9b-a741-341ddb09d446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2004a0d7-aa2d-490a-8206-709602961081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2004a0d7-aa2d-490a-8206-709602961081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-996117002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3320f80b-7e40-4f65-8c59-4c6fc5511b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2658d90e1344916afbfa86ec0c006d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:23Z,use_quota=True,user_id='d0cbc36f77214e9787bf74d2664e1433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ab381a-ac6a-476e-8ff8-0cfb80908a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ab381a-ac6a-476e-8ff8-0cfb80908a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462e94fb-d5c6-46b6-8fe4-d7ca584fe31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462e94fb-d5c6-46b6-8fe4-d7ca584fe31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3320f80b-7e40-4f65-8c59-4c6fc5511b32', 'volume_name': 'volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a46e08-382f-4cfc-bbfd-db893d36ab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a46e08-382f-4cfc-bbfd-db893d36ab78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:23 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0487ff6a-bd78-4fde-a78a-eee698fa1efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Volume 3320f80b-7e40-4f65-8c59-4c6fc5511b32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32', 'volume_size': 1}
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ada36f40-e5bf-448e-8e4b-66c974787f6b -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c" returned: 0 in 0.425s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:23 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:23 devstack sudo[95972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c
Sep 29 12:30:23 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:23 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c" returned: 0 in 0.279s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:23 devstack sudo[95975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.info
Sep 29 12:30:23 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:23 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.info" returned: 0 in 0.280s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:23 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:30:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:23 devstack sudo[95980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.info
Sep 29 12:30:24 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:24 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.info" returned: 0 in 0.302s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.919s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-996117002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3320f80b-7e40-4f65-8c59-4c6fc5511b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2658d90e1344916afbfa86ec0c006d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:23Z,use_quota=True,user_id='d0cbc36f77214e9787bf74d2664e1433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Creating volume 3320f80b-7e40-4f65-8c59-4c6fc5511b32 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:30:24 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:24 devstack sudo[95983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32 1073741824
Sep 29 12:30:24 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-852b4ee4-e9c6-4ff8-a5c7-889a7940afda tempest-GroupSnapshotsTest-1083032981 None] group_snapshot db21f81e-11da-4784-94e0-0a84640239f4: created successfully
Sep 29 12:30:24 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32 1073741824" returned: 0 in 0.645s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:25 devstack sudo[96019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32
Sep 29 12:30:25 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:25 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] group_snapshot db21f81e-11da-4784-94e0-0a84640239f4: deleting
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32" returned: 0 in 0.518s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.042s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0487ff6a-bd78-4fde-a78a-eee698fa1efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400b0743-213e-4172-8306-729e9b4978cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] Creating offline snapshot f161a68c-0f28-4c9d-b385-6796bc130424 of volume 9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] group_snapshot db21f81e-11da-4784-94e0-0a84640239f4: deleting {{(pid=86369) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 29 12:30:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Volume volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32 (3320f80b-7e40-4f65-8c59-4c6fc5511b32): created successfully
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400b0743-213e-4172-8306-729e9b4978cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Flow 'volume_create_manager' (0fb2d376-a788-4c9b-a741-341ddb09d446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[61816f71-434a-4ebc-98b1-c430a968c428]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6699d967-8df0-4b15-aafb-e3fcc5a968a2 tempest-VolumesListAdminTestJSON-369327781 None] Created volume successfully.
Sep 29 12:30:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-f2b487c1-653e-46eb-8388-77b4f4371481" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-f2b487c1-653e-46eb-8388-77b4f4371481" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-5cdecabf-9fc2-4ff4-a7a3-158028fa1700" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-5cdecabf-9fc2-4ff4-a7a3-158028fa1700" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Deleting offline snapshot 5cdecabf-9fc2-4ff4-a7a3-158028fa1700 of volume f2b487c1-653e-46eb-8388-77b4f4371481 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:30:26 devstack sudo[96049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:26 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] snapshot_file for this snap is: volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[85861da8-0334-4845-a82f-9a1e47eb6c18]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:26 devstack sudo[96060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700
Sep 29 12:30:26 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:26 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.579s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:26 devstack sudo[96082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424 1G
Sep 29 12:30:26 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:26 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700" returned: 0 in 0.471s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2b487c1-653e-46eb-8388-77b4f4371481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddcabb1-f2eb-4b89-ab65-ccb240c41970]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:26 devstack sudo[96086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481
Sep 29 12:30:26 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:30:27 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Flow 'volume_create_manager' (ad9d61f7-3269-43cd-97ba-bf45c5319f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cc0004-c3fc-4e1e-85c9-5de0db7f38b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:27 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424 1G" returned: 0 in 0.699s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481" returned: 0 in 0.558s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:27 devstack sudo[96095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424
Sep 29 12:30:27 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cc0004-c3fc-4e1e-85c9-5de0db7f38b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2078783571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad5ff4c0-e1e9-4160-b8f1-d10243532edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2658d90e1344916afbfa86ec0c006d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:27Z,use_quota=True,user_id='d0cbc36f77214e9787bf74d2664e1433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275fedc4-256e-4be8-91b2-d1d9535898c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:27 devstack sudo[96096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700
Sep 29 12:30:27 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275fedc4-256e-4be8-91b2-d1d9535898c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31afc306-909b-4782-a206-598fb753556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31afc306-909b-4782-a206-598fb753556b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad5ff4c0-e1e9-4160-b8f1-d10243532edb', 'volume_name': 'volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcff6744-d78e-41d0-99f4-66e42994ee6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcff6744-d78e-41d0-99f4-66e42994ee6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97183ce7-d77c-48ec-b360-d1658213cf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:27 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Volume ad5ff4c0-e1e9-4160-b8f1-d10243532edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb', 'volume_size': 1}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:27 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424" returned: 0 in 0.475s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:27 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424 is being set with open permissions: ugo+rw
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:27 devstack sudo[96109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424
Sep 29 12:30:27 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:27 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700" returned: 0 in 0.541s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:27 devstack sudo[96111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700
Sep 29 12:30:27 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:27 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.747s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2078783571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad5ff4c0-e1e9-4160-b8f1-d10243532edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2658d90e1344916afbfa86ec0c006d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:27Z,use_quota=True,user_id='d0cbc36f77214e9787bf74d2664e1433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Creating volume ad5ff4c0-e1e9-4160-b8f1-d10243532edb {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:30:28 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:28 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481.5cdecabf-9fc2-4ff4-a7a3-158028fa1700" returned: 0 in 0.324s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:28 devstack sudo[96115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb 1073741824
Sep 29 12:30:28 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-5cdecabf-9fc2-4ff4-a7a3-158028fa1700" released by "_delete_snapshot" :: held 2.058s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-f2b487c1-653e-46eb-8388-77b4f4371481" released by "delete_snapshot" :: held 2.108s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8b11064d-c09d-4fc4-8276-d7f0c4c7038d tempest-SnapshotsActionsTest-1206955278 None] Create snapshot completed successfully
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-ada36f40-e5bf-448e-8e4b-66c974787f6b" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-ada36f40-e5bf-448e-8e4b-66c974787f6b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-f27f65c9-bbb2-4992-97fb-e6df86d8bd6c" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-f27f65c9-bbb2-4992-97fb-e6df86d8bd6c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Deleting offline snapshot f27f65c9-bbb2-4992-97fb-e6df86d8bd6c of volume ada36f40-e5bf-448e-8e4b-66c974787f6b {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] snapshot_file for this snap is: volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aad0751-579d-4007-a903-e8def897ea13]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:28 devstack sudo[96117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c
Sep 29 12:30:28 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:28 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb 1073741824" returned: 0 in 0.533s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:28 devstack sudo[96125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb
Sep 29 12:30:28 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:28 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ada36f40-e5bf-448e-8e4b-66c974787f6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1711f40c-9ab9-4de3-ae4f-b933649855e1]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:28 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb" returned: 0 in 0.311s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97183ce7-d77c-48ec-b360-d1658213cf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94d5b3c-8708-44a8-9452-0512b3fcdc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:28 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Volume volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb (ad5ff4c0-e1e9-4160-b8f1-d10243532edb): created successfully
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94d5b3c-8708-44a8-9452-0512b3fcdc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Flow 'volume_create_manager' (ad9d61f7-3269-43cd-97ba-bf45c5319f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:28 devstack sudo[96128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b
Sep 29 12:30:28 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b8be762f-3d28-4618-ac93-7ecdf51d4657 tempest-VolumesListAdminTestJSON-369327781 None] Created volume successfully.
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Acquiring lock "cinder-f161a68c-0f28-4c9d-b385-6796bc130424-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-f161a68c-0f28-4c9d-b385-6796bc130424-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Acquiring lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Acquiring lock "cinder-quobyte-f161a68c-0f28-4c9d-b385-6796bc130424" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-f161a68c-0f28-4c9d-b385-6796bc130424" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Deleting offline snapshot f161a68c-0f28-4c9d-b385-6796bc130424 of volume 9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] snapshot_file for this snap is: volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb5c53a-b805-4779-93c0-3148c3de60b7]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:29 devstack sudo[96131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424
Sep 29 12:30:29 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:29 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b" returned: 0 in 0.700s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:29 devstack sudo[96139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c
Sep 29 12:30:29 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:29 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424" returned: 0 in 0.668s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee76de6-53f9-4190-a86a-1b97be941e3b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:30:30 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:30 devstack sudo[96167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:30 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Flow 'volume_create_manager' (d0c26976-3691-4b04-980a-461bd45dff07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f144274-943c-4ac6-aebf-9fc10defe9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c" returned: 0 in 0.831s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f144274-943c-4ac6-aebf-9fc10defe9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-102861329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0423c80-3769-4c17-ba7a-c21011032202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2658d90e1344916afbfa86ec0c006d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:30Z,use_quota=True,user_id='d0cbc36f77214e9787bf74d2664e1433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7112fbe7-d02a-4220-b231-1fe101575b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:30 devstack sudo[96170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c
Sep 29 12:30:30 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7112fbe7-d02a-4220-b231-1fe101575b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f209217-2571-4b89-a8fb-fd3f2fec6d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f209217-2571-4b89-a8fb-fd3f2fec6d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0423c80-3769-4c17-ba7a-c21011032202', 'volume_name': 'volume-c0423c80-3769-4c17-ba7a-c21011032202', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382c3c0d-853e-4809-8871-4c283ef49da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382c3c0d-853e-4809-8871-4c283ef49da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2531db-4a31-4cb9-81e8-a43e4346337d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:30 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Volume c0423c80-3769-4c17-ba7a-c21011032202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0423c80-3769-4c17-ba7a-c21011032202', 'volume_size': 1}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-102861329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0423c80-3769-4c17-ba7a-c21011032202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2658d90e1344916afbfa86ec0c006d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:30Z,use_quota=True,user_id='d0cbc36f77214e9787bf74d2664e1433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Creating volume c0423c80-3769-4c17-ba7a-c21011032202 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:30:30 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c0423c80-3769-4c17-ba7a-c21011032202 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:30 devstack sudo[96172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c0423c80-3769-4c17-ba7a-c21011032202 1073741824
Sep 29 12:30:30 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:30 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.498s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:30 devstack sudo[96179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424
Sep 29 12:30:30 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:30 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b.f27f65c9-bbb2-4992-97fb-e6df86d8bd6c" returned: 0 in 0.346s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-f27f65c9-bbb2-4992-97fb-e6df86d8bd6c" released by "_delete_snapshot" :: held 2.513s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-ada36f40-e5bf-448e-8e4b-66c974787f6b" released by "delete_snapshot" :: held 2.545s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:30 devstack cinder-volume[86369]: WARNING cinder.quota [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1118718131 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1118718131, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:30:30 devstack cinder-volume[86369]: WARNING cinder.quota [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1118718131 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1118718131, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:30:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['7579f017-2b91-4cb1-ab23-50d9f736e99d', '4344d95e-e3e2-4f5b-bdbf-0e6d9a97b5e0', '6ec9362d-7a9f-4e86-bda4-61676517d477', 'ae2fff78-a078-4354-bc20-f1d60e1cd6ac'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['f81eb9a3-5079-420b-8eff-62a51e042e0a', 'a534124f-97ed-4dc0-b8b7-98a5c28783ea', '6cfe1f65-6c83-4949-915f-a865aa1c4c86', 'a2c1ea32-90ba-4bb2-b46f-15d30df8bcd5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:31 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c0423c80-3769-4c17-ba7a-c21011032202 1073741824" returned: 0 in 0.693s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c0423c80-3769-4c17-ba7a-c21011032202 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:31 devstack sudo[96192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c0423c80-3769-4c17-ba7a-c21011032202
Sep 29 12:30:31 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a602afae-f54f-4824-9709-73d951c2f29d tempest-GroupSnapshotsTest-1083032981 None] group_snapshot db21f81e-11da-4784-94e0-0a84640239f4: deleted successfully
Sep 29 12:30:31 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424" returned: 0 in 0.712s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:31 devstack sudo[96194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424
Sep 29 12:30:31 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:31 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c0423c80-3769-4c17-ba7a-c21011032202" returned: 0 in 0.357s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:31 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2531db-4a31-4cb9-81e8-a43e4346337d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0423c80-3769-4c17-ba7a-c21011032202', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3449b6ac-75ee-4388-872a-455fab80d53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.f161a68c-0f28-4c9d-b385-6796bc130424" returned: 0 in 0.319s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-f161a68c-0f28-4c9d-b385-6796bc130424" released by "_delete_snapshot" :: held 2.394s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:31 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Volume volume-c0423c80-3769-4c17-ba7a-c21011032202 (c0423c80-3769-4c17-ba7a-c21011032202): created successfully
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3449b6ac-75ee-4388-872a-455fab80d53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Flow 'volume_create_manager' (d0c26976-3691-4b04-980a-461bd45dff07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" released by "delete_snapshot" :: held 2.440s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-319795f8-7866-4bce-ac9a-7d537ad00a50 tempest-VolumesListAdminTestJSON-369327781 None] Created volume successfully.
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Created reservations ['8fcf7e5c-293d-4850-9982-aaea35473574', 'e7cd09c4-7a73-44a9-b5bf-2591b81e9552', '44510f8c-f2df-4453-86b8-512f17a08dd4', 'd975ad73-edd7-47bc-9b4e-b01810167f19'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Delete snapshot completed successfully.
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bc45e6a5-8c16-4f38-8f26-d8f2759538ae tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-f161a68c-0f28-4c9d-b385-6796bc130424-delete_snapshot" released by "delete_snapshot" :: held 2.640s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-ada36f40-e5bf-448e-8e4b-66c974787f6b" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-ada36f40-e5bf-448e-8e4b-66c974787f6b" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcc6721-9504-4d9e-8c70-c9f1c87f0b42]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:32 devstack sudo[96199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b
Sep 29 12:30:32 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:32 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b" returned: 0 in 0.452s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:32 devstack sudo[96204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b
Sep 29 12:30:32 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] Creating offline snapshot 5f5d72c2-88e4-453a-9218-467ea14b3bb9 of volume 9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[774ba7bb-4028-45a3-85ec-aaedb82dc3ba]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:32 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ada36f40-e5bf-448e-8e4b-66c974787f6b" returned: 0 in 0.330s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-ada36f40-e5bf-448e-8e4b-66c974787f6b" released by "delete_volume" :: held 0.878s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-f2b487c1-653e-46eb-8388-77b4f4371481" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-f2b487c1-653e-46eb-8388-77b4f4371481" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:32 devstack sudo[96206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:32 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[234e7d44-9baf-4c20-b711-7810fe15a0f2]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Flow 'volume_create_manager' (19c8a5a7-9896-4742-baf6-1f19921775cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:33 devstack sudo[96209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481
Sep 29 12:30:33 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb129de-6972-456e-aac7-65253fa3a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb129de-6972-456e-aac7-65253fa3a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e2c8d1-7ed5-4138-a801-6191668ce141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486a53619b1d47b78a7050708be1a7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:33Z,use_quota=True,user_id='d1a08b16b6724967935f800e6f7376d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1edc01-29d8-434a-8ca8-e9bd64a03a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1edc01-29d8-434a-8ca8-e9bd64a03a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f4e4d8-c038-4626-9931-06b3284d2930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f4e4d8-c038-4626-9931-06b3284d2930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e2c8d1-7ed5-4138-a801-6191668ce141', 'volume_name': 'volume-76e2c8d1-7ed5-4138-a801-6191668ce141', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca1ecd0-1d31-4f4a-82f9-ad23754a98cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca1ecd0-1d31-4f4a-82f9-ad23754a98cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635a76ae-f6ce-4f92-8606-2ed929992e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Volume 76e2c8d1-7ed5-4138-a801-6191668ce141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e2c8d1-7ed5-4138-a801-6191668ce141', 'volume_size': 1}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:33 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.490s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:33 devstack sudo[96214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9 1G
Sep 29 12:30:33 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:33 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481" returned: 0 in 0.423s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:33 devstack sudo[96219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481
Sep 29 12:30:33 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:33 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f2b487c1-653e-46eb-8388-77b4f4371481" returned: 0 in 0.297s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-f2b487c1-653e-46eb-8388-77b4f4371481" released by "delete_volume" :: held 0.808s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:33 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9 1G" returned: 0 in 0.568s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['b41c7f32-de79-4732-a8fa-c9415dc5d64f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:33 devstack sudo[96226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9
Sep 29 12:30:33 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:33 devstack cinder-volume[86369]: WARNING cinder.quota [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1118718131 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1118718131, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:30:33 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['883a064f-0001-450f-abd3-9902a39f59ae', '6476f0ec-e5f3-4a5e-9854-bfde1a04161d', '96c93644-4152-46bf-9b24-e3430df80019', 'b60e187d-716e-4f78-a3d4-6af9d77b613c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['36ae814a-4ee9-4171-854d-3cb7014550db', '611e03fb-e122-458a-a999-e7dfc6835284', '67160f1f-cf32-4246-a59c-8216de4af9d2', '06c3d9c9-6bf9-46f1-b087-3052e65dcd8b'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:34 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9" returned: 0 in 0.405s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:34 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9 is being set with open permissions: ugo+rw
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:34 devstack sudo[96232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:30:34 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:34 devstack sudo[96233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9
Sep 29 12:30:34 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:34 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:34 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9" returned: 0 in 0.285s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-48911940-caff-4fc0-8719-8c898f172978 tempest-GroupSnapshotsTest-1083032981 None] Delete group completed successfully.
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.441s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e2c8d1-7ed5-4138-a801-6191668ce141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486a53619b1d47b78a7050708be1a7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:33Z,use_quota=True,user_id='d1a08b16b6724967935f800e6f7376d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Creating volume 76e2c8d1-7ed5-4138-a801-6191668ce141 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:30:34 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-76e2c8d1-7ed5-4138-a801-6191668ce141 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:34 devstack sudo[96238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-76e2c8d1-7ed5-4138-a801-6191668ce141 1073741824
Sep 29 12:30:34 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-42ab4d31-ae3e-4f68-8fc6-cecd714b4d53 tempest-SnapshotsActionsTest-1206955278 None] Create snapshot completed successfully
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Acquiring lock "cinder-5f5d72c2-88e4-453a-9218-467ea14b3bb9-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6ffd2db6-1284-433b-93e4-60a3591f98c2 tempest-GroupSnapshotsTest-1083032981 None] Group tempest-GroupSnapshotsTest-Group-515555505: creating
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-5f5d72c2-88e4-453a-9218-467ea14b3bb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Acquiring lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Acquiring lock "cinder-quobyte-5f5d72c2-88e4-453a-9218-467ea14b3bb9" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6ffd2db6-1284-433b-93e4-60a3591f98c2 tempest-GroupSnapshotsTest-1083032981 None] Group tempest-GroupSnapshotsTest-Group-515555505: created successfully
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-5f5d72c2-88e4-453a-9218-467ea14b3bb9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Deleting offline snapshot 5f5d72c2-88e4-453a-9218-467ea14b3bb9 of volume 9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] snapshot_file for this snap is: volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:30:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6ffd2db6-1284-433b-93e4-60a3591f98c2 tempest-GroupSnapshotsTest-1083032981 None] Create group completed successfully.
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db81c4a-9f9f-4ed8-b615-2bb6b151520b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:35 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-76e2c8d1-7ed5-4138-a801-6191668ce141 1073741824" returned: 0 in 0.589s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:35 devstack sudo[96246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9
Sep 29 12:30:35 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-76e2c8d1-7ed5-4138-a801-6191668ce141 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:35 devstack sudo[96248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-76e2c8d1-7ed5-4138-a801-6191668ce141
Sep 29 12:30:35 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:35 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9" returned: 0 in 0.416s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:35 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-76e2c8d1-7ed5-4138-a801-6191668ce141" returned: 0 in 0.298s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04c9072-1ee3-414c-bd2a-4199df92c327]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635a76ae-f6ce-4f92-8606-2ed929992e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e2c8d1-7ed5-4138-a801-6191668ce141', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf160f2-cba0-4274-83f3-80f1d5a0c153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:35 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Volume volume-76e2c8d1-7ed5-4138-a801-6191668ce141 (76e2c8d1-7ed5-4138-a801-6191668ce141): created successfully
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf160f2-cba0-4274-83f3-80f1d5a0c153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Flow 'volume_create_manager' (19c8a5a7-9896-4742-baf6-1f19921775cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-64dc57ba-0267-4a93-a62d-780813c1150f tempest-VolumesListAdminTestJSON-547617466 None] Created volume successfully.
Sep 29 12:30:35 devstack sudo[96255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:35 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:35 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.390s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:35 devstack sudo[96262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9
Sep 29 12:30:35 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Acquiring lock "cinder-76e2c8d1-7ed5-4138-a801-6191668ce141-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Lock "cinder-76e2c8d1-7ed5-4138-a801-6191668ce141-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Acquiring lock "cinder-quobyte-76e2c8d1-7ed5-4138-a801-6191668ce141" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Lock "cinder-quobyte-76e2c8d1-7ed5-4138-a801-6191668ce141" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:36 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9" returned: 0 in 0.549s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad327bd-53b7-42ac-b53c-48950714318e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-76e2c8d1-7ed5-4138-a801-6191668ce141 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:36 devstack sudo[96267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9
Sep 29 12:30:36 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "cinder-c0423c80-3769-4c17-ba7a-c21011032202-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:30:36 devstack sudo[96269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-76e2c8d1-7ed5-4138-a801-6191668ce141
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Flow 'volume_create_manager' (767807c3-bf6d-4f26-b9fd-2301fc933707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:36 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d46ca88-b505-4ce9-92e5-4810b98cef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Lock "cinder-c0423c80-3769-4c17-ba7a-c21011032202-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d46ca88-b505-4ce9-92e5-4810b98cef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-188511154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=34507787-0c6a-4210-8146-ebbacc7ea278,host='devstack@QuobyteHD#QuobyteHD',id=f3619e51-9aa1-4a19-917f-7f52256e7b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61de0ea04c214c529d7f682095a41b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:37Z,use_quota=True,user_id='b0211da772814965a9dc0082504ded27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f716fa14-979a-47ea-9dcd-fc633746d200),volume_type_id=f716fa14-979a-47ea-9dcd-fc633746d200)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd607b8-d0d0-4996-ab0f-934e36ca52bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd607b8-d0d0-4996-ab0f-934e36ca52bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1220636-e00f-482c-8332-aa9e3a45e18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1220636-e00f-482c-8332-aa9e3a45e18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3619e51-9aa1-4a19-917f-7f52256e7b5d', 'volume_name': 'volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843ca9dc-55d9-4324-8c9e-61044a9f459c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843ca9dc-55d9-4324-8c9e-61044a9f459c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bd64c8-6d5c-4b8d-872a-ecd31452db0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Volume f3619e51-9aa1-4a19-917f-7f52256e7b5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d', 'volume_size': 1}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=34507787-0c6a-4210-8146-ebbacc7ea278,created_at=2026-09-29T10:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-188511154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=34507787-0c6a-4210-8146-ebbacc7ea278,host='devstack@QuobyteHD#QuobyteHD',id=f3619e51-9aa1-4a19-917f-7f52256e7b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61de0ea04c214c529d7f682095a41b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:37Z,use_quota=True,user_id='b0211da772814965a9dc0082504ded27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f716fa14-979a-47ea-9dcd-fc633746d200),volume_type_id=f716fa14-979a-47ea-9dcd-fc633746d200)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Creating volume f3619e51-9aa1-4a19-917f-7f52256e7b5d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:36 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:30:36 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.5f5d72c2-88e4-453a-9218-467ea14b3bb9" returned: 0 in 0.431s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:36 devstack sudo[96272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d 1073741824
Sep 29 12:30:36 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-5f5d72c2-88e4-453a-9218-467ea14b3bb9" released by "_delete_snapshot" :: held 1.933s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "cinder-quobyte-c0423c80-3769-4c17-ba7a-c21011032202" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" released by "delete_snapshot" :: held 1.986s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Lock "cinder-quobyte-c0423c80-3769-4c17-ba7a-c21011032202" acquired by "delete_volume" :: waited 0.042s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dc547a-5d9f-45ac-b597-6e0bcc8ade34]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c0423c80-3769-4c17-ba7a-c21011032202 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Created reservations ['d809adc5-a98f-4bfe-bcee-41818bcf4986', '3a707edf-0749-40db-830c-06f521418c1e', 'd544ea86-e02e-4177-a4b7-9c80458f9ed6', '9b7d6408-08a4-44a2-9bd4-353e97e20f46'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:37 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-76e2c8d1-7ed5-4138-a801-6191668ce141" returned: 0 in 0.698s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-76e2c8d1-7ed5-4138-a801-6191668ce141 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:37 devstack sudo[96281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-76e2c8d1-7ed5-4138-a801-6191668ce141
Sep 29 12:30:37 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:37 devstack sudo[96277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c0423c80-3769-4c17-ba7a-c21011032202
Sep 29 12:30:37 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Delete snapshot completed successfully.
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e37c167a-164f-431e-9b02-081ec571803f tempest-SnapshotsActionsTest-1757959230 None] Lock "cinder-5f5d72c2-88e4-453a-9218-467ea14b3bb9-delete_snapshot" released by "delete_snapshot" :: held 2.317s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:37 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d 1073741824" returned: 0 in 0.587s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:37 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-76e2c8d1-7ed5-4138-a801-6191668ce141" returned: 0 in 0.298s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Lock "cinder-quobyte-76e2c8d1-7ed5-4138-a801-6191668ce141" released by "delete_volume" :: held 1.075s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:37 devstack sudo[96291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d
Sep 29 12:30:37 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:37 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Created reservations ['c98b3efc-18a7-45dc-b0d5-01ef0cf1ce46', '1a1b313c-48f2-4cc4-976c-f533b3872e66', '14ed44af-0983-4ecc-80c7-87c5115c20f0', 'a57186f1-5231-4fa2-9d4c-73cff47cb3d6'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c0423c80-3769-4c17-ba7a-c21011032202" returned: 0 in 0.538s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c0423c80-3769-4c17-ba7a-c21011032202 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:37 devstack sudo[96293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c0423c80-3769-4c17-ba7a-c21011032202
Sep 29 12:30:37 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:37 devstack sudo[96295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:30:37 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:37 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d" returned: 0 in 0.282s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bd64c8-6d5c-4b8d-872a-ecd31452db0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67499372-4b77-482b-8280-1670a70d0a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:37 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Volume volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d (f3619e51-9aa1-4a19-917f-7f52256e7b5d): created successfully
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67499372-4b77-482b-8280-1670a70d0a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Flow 'volume_create_manager' (767807c3-bf6d-4f26-b9fd-2301fc933707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-54e7fafe-a131-4020-b2d8-382b4d12e277 tempest-GroupSnapshotsTest-1083032981 None] Created volume successfully.
Sep 29 12:30:38 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:38 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c0423c80-3769-4c17-ba7a-c21011032202" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.303s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Lock "cinder-quobyte-c0423c80-3769-4c17-ba7a-c21011032202" released by "delete_volume" :: held 1.031s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Deleted volume successfully.
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5298300b-e787-4ef0-ad00-ee15c11fea86 tempest-VolumesListAdminTestJSON-547617466 None] Lock "cinder-76e2c8d1-7ed5-4138-a801-6191668ce141-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Created reservations ['dc2870f7-153b-46ee-af16-17f3487711a2', '5ad0d20f-de16-4987-ae5f-540ffd02e358', '634bb4d0-2e23-458a-bded-5efb5fbb7122', 'f0cf9a37-05b9-4418-9d51-93464d83abc3'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:38 devstack sudo[96300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:30:38 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] GroupSnapshot b8099bbf-64c2-4e56-a62a-8edd95b07a7c: creating.
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] Group snapshot b8099bbf-64c2-4e56-a62a-8edd95b07a7c: creating. {{(pid=86369) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] Creating offline snapshot cc516b34-be3c-48ab-bd3b-dd876d47c7fa of volume f3619e51-9aa1-4a19-917f-7f52256e7b5d {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de40eee-934e-4692-81c2-4795d53e0c7e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:38 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.352s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:30:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Deleted volume successfully.
Sep 29 12:30:38 devstack sudo[96302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d
Sep 29 12:30:38 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-af3ddd0a-11d4-4dc5-86b7-be23e00eccd1 tempest-VolumesListAdminTestJSON-369327781 None] Lock "cinder-c0423c80-3769-4c17-ba7a-c21011032202-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "cinder-becc3b0a-c0c5-4e0e-9387-38b89df130ca-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Lock "cinder-becc3b0a-c0c5-4e0e-9387-38b89df130ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "cinder-quobyte-becc3b0a-c0c5-4e0e-9387-38b89df130ca" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Lock "cinder-quobyte-becc3b0a-c0c5-4e0e-9387-38b89df130ca" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Deleting offline snapshot becc3b0a-c0c5-4e0e-9387-38b89df130ca of volume 9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] snapshot_file for this snap is: volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a067611-21ef-4bac-a751-07c493501ee8]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:38 devstack sudo[96305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:38 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:38 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d" returned: 0 in 0.462s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:39 devstack sudo[96311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa 1G
Sep 29 12:30:39 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "cinder-ad5ff4c0-e1e9-4160-b8f1-d10243532edb-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Lock "cinder-ad5ff4c0-e1e9-4160-b8f1-d10243532edb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:39 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "cinder-quobyte-ad5ff4c0-e1e9-4160-b8f1-d10243532edb" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.486s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Lock "cinder-quobyte-ad5ff4c0-e1e9-4160-b8f1-d10243532edb" acquired by "delete_volume" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b26b73-684d-4261-b18b-17dd495570df]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fc9b7d-334f-4fa4-9a6b-f93bb0c4e2bd]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:39 devstack sudo[96320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb
Sep 29 12:30:39 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:39 devstack sudo[96319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e
Sep 29 12:30:39 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:39 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa 1G" returned: 0 in 0.542s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:39 devstack sudo[96324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa
Sep 29 12:30:39 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:39 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb" returned: 0 in 0.432s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:39 devstack sudo[96334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb
Sep 29 12:30:39 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:39 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" returned: 0 in 0.486s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:39 devstack sudo[96337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:39 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:39 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa" returned: 0 in 0.372s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:39 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:30:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:39 devstack sudo[96339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa
Sep 29 12:30:39 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:40 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad5ff4c0-e1e9-4160-b8f1-d10243532edb" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Lock "cinder-quobyte-ad5ff4c0-e1e9-4160-b8f1-d10243532edb" released by "delete_volume" :: held 0.835s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:40 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:40 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.421s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Created reservations ['ec1f4d4f-83ec-4f74-89c3-5a2d6c46d785', '680bc03e-718e-4fcf-8611-35e3aca96824', '342a5070-0911-4bba-b91f-7f870b2e73c6', '6ea0bbdb-790a-4bc3-aeda-e9d590fd9fa7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:40 devstack sudo[96347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.info
Sep 29 12:30:40 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:40 devstack sudo[96348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca
Sep 29 12:30:40 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:40 devstack sudo[96351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:30:40 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "cinder-3320f80b-7e40-4f65-8c59-4c6fc5511b32-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Lock "cinder-3320f80b-7e40-4f65-8c59-4c6fc5511b32-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:40 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.info" returned: 0 in 0.357s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:40 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:40 devstack sudo[96355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.info
Sep 29 12:30:40 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "cinder-quobyte-3320f80b-7e40-4f65-8c59-4c6fc5511b32" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:40 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Lock "cinder-quobyte-3320f80b-7e40-4f65-8c59-4c6fc5511b32" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e.becc3b0a-c0c5-4e0e-9387-38b89df130ca" returned: 0 in 0.491s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99de1a3-643c-40e2-a8e0-bafbfd783079]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Lock "cinder-quobyte-becc3b0a-c0c5-4e0e-9387-38b89df130ca" released by "_delete_snapshot" :: held 2.084s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:40 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" released by "delete_snapshot" :: held 2.122s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.454s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:30:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Deleted volume successfully.
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9e298fb4-a18a-4c62-b99c-5b7b2ca40309 tempest-VolumesListAdminTestJSON-369327781 None] Lock "cinder-ad5ff4c0-e1e9-4160-b8f1-d10243532edb-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:40 devstack sudo[96358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32
Sep 29 12:30:40 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Created reservations ['9847c1f7-a218-41c3-8606-9a654b97f92b', 'cccaaba8-7a35-4790-8a8f-fe51af393165', '9e4c9be2-607e-47ed-9084-5febd4a32011', '43c87f0d-b384-410f-ba96-5910daa7f8cc'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:40 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.info" returned: 0 in 0.406s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.554s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Delete snapshot completed successfully.
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d359f7a-0347-4db5-b0dc-d5df965afe2f tempest-SnapshotsActionsTest-1206955278 None] Lock "cinder-becc3b0a-c0c5-4e0e-9387-38b89df130ca-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0aa80529-fb73-4091-98e1-fb61af8d9033 tempest-GroupSnapshotsTest-1083032981 None] group_snapshot b8099bbf-64c2-4e56-a62a-8edd95b07a7c: created successfully
Sep 29 12:30:41 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32" returned: 0 in 0.498s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:41 devstack sudo[96364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32
Sep 29 12:30:41 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:41 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3320f80b-7e40-4f65-8c59-4c6fc5511b32" returned: 0 in 0.262s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Lock "cinder-quobyte-3320f80b-7e40-4f65-8c59-4c6fc5511b32" released by "delete_volume" :: held 0.817s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Created reservations ['a58b2872-8fff-4ea8-869a-5c21be79fbe4', '98d1585c-ec18-44bc-88d3-17003ffb17e9', 'b664c16d-b91c-4e60-b0c7-010f0a9c1e44', 'a9a984e1-f6d1-48ba-a925-2d06a6d470a4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:41 devstack sudo[96367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:30:41 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] group_snapshot b8099bbf-64c2-4e56-a62a-8edd95b07a7c: deleting
Sep 29 12:30:42 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] group_snapshot b8099bbf-64c2-4e56-a62a-8edd95b07a7c: deleting {{(pid=86369) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 29 12:30:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Deleted volume successfully.
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-f3619e51-9aa1-4a19-917f-7f52256e7b5d" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310e0f60-2fe3-49e5-b8e1-b0def8ff2d2f tempest-VolumesListAdminTestJSON-369327781 None] Lock "cinder-3320f80b-7e40-4f65-8c59-4c6fc5511b32-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "cinder-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-f3619e51-9aa1-4a19-917f-7f52256e7b5d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-cc516b34-be3c-48ab-bd3b-dd876d47c7fa" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Lock "cinder-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-cc516b34-be3c-48ab-bd3b-dd876d47c7fa" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Deleting offline snapshot cc516b34-be3c-48ab-bd3b-dd876d47c7fa of volume f3619e51-9aa1-4a19-917f-7f52256e7b5d {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] snapshot_file for this snap is: volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f7066c-f7f4-457f-86ce-282b0c355721]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Acquiring lock "cinder-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06b4b0c-428a-495c-a1ce-894269d33d7a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:42 devstack sudo[96370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa
Sep 29 12:30:42 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Lock "cinder-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Acquiring lock "cinder-quobyte-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Lock "cinder-quobyte-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:42 devstack sudo[96371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e
Sep 29 12:30:42 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[800b6372-d124-460a-a86c-3474a2d50b5b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:42 devstack sudo[96374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00
Sep 29 12:30:42 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:42 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa" returned: 0 in 0.511s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:30:42 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" returned: 0 in 0.440s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a851a4-5615-4947-9175-8cf1fe3d8501]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:42 devstack sudo[96382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e
Sep 29 12:30:42 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:42 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00" returned: 0 in 0.446s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:42 devstack sudo[96383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d
Sep 29 12:30:42 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:42 devstack sudo[96389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00
Sep 29 12:30:42 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:43 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" returned: 0 in 0.298s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Lock "cinder-quobyte-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e" released by "delete_volume" :: held 0.842s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Created reservations ['3d060364-7d68-418b-b865-b1213909f6a4', '4445c638-5d0e-4b15-a678-ffe6dfbc3aeb', '42a0f6db-c8a3-4f1f-b6b6-7086f5e51bf6', '350e097a-fdc6-45d8-9bde-e3cf8a7deaf8'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:43 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:43 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d" returned: 0 in 0.509s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:43 devstack sudo[96397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:30:43 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00" returned: 0 in 0.392s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:43 devstack sudo[96398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Lock "cinder-quobyte-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00" released by "delete_volume" :: held 0.911s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:43 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Created reservations ['a70cabab-4300-4176-92d2-b19e4b1c63d2', 'da5594db-a2aa-453a-9b42-2113c5f91b49', '941638b7-bd20-4e08-ac35-e201c1c40d69', 'cb840f03-ae44-4e44-b6c7-ebac3e38ea66'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:43 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.401s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:30:43 devstack sudo[96402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:30:43 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:43 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Deleted volume successfully.
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-abf6e39b-95ad-4df6-884f-2df7ea44942f tempest-SnapshotsActionsTest-1206955278 None] Lock "cinder-9dc221a6-f8c5-4926-a989-8fb6edc5cb6e-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:43 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa" returned: 0 in 0.616s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:43 devstack sudo[96408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa
Sep 29 12:30:43 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:44 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.341s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:44 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:30:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Deleted volume successfully.
Sep 29 12:30:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0efaa3ca-8c45-42ee-a1ea-deba1c44314c tempest-VolumesNegativeTest-1222720730 None] Lock "cinder-d8c3d071-17aa-49a2-8c2d-0e96f38bfe00-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:44 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d.cc516b34-be3c-48ab-bd3b-dd876d47c7fa" returned: 0 in 0.320s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-cc516b34-be3c-48ab-bd3b-dd876d47c7fa" released by "_delete_snapshot" :: held 2.146s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-f3619e51-9aa1-4a19-917f-7f52256e7b5d" released by "delete_snapshot" :: held 2.218s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:44 devstack cinder-volume[86369]: WARNING cinder.quota [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-762021184 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-762021184, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:30:44 devstack cinder-volume[86369]: WARNING cinder.quota [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-762021184 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-762021184, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:30:44 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['6343890e-d60f-4330-a717-67c453e23a45', '92d59ea1-7589-49f7-9888-1ca4192e359b', 'c55db348-8906-466c-af91-da7df10d5d6e', 'c1bc778c-c69e-4f65-9329-8b5dbdb602ac'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d5f800c0-0e52-457a-bb16-1fe2998c3015 tempest-GroupSnapshotsTest-1083032981 None] group_snapshot b8099bbf-64c2-4e56-a62a-8edd95b07a7c: deleted successfully
Sep 29 12:30:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "cinder-quobyte-f3619e51-9aa1-4a19-917f-7f52256e7b5d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:30:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-f3619e51-9aa1-4a19-917f-7f52256e7b5d" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:30:46 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f753a8-6a5b-4fee-9e59-9d4c4e44299d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:46 devstack sudo[96412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d
Sep 29 12:30:46 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:46 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d" returned: 0 in 0.511s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:46 devstack sudo[96417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d
Sep 29 12:30:46 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:46 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f3619e51-9aa1-4a19-917f-7f52256e7b5d" returned: 0 in 0.348s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Lock "cinder-quobyte-f3619e51-9aa1-4a19-917f-7f52256e7b5d" released by "delete_volume" :: held 0.969s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:30:47 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['43dddb0d-ae40-4c39-963e-0001f2ad3737'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:47 devstack cinder-volume[86369]: WARNING cinder.quota [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-762021184 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-762021184, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:30:47 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Created reservations ['025d46b8-2028-40de-960f-4175011195d0', '4c1691ce-c66e-4c62-9e78-2982a6a88036', 'c783494b-4f53-41cf-a0af-8aea9613bd5b', '8b1a7b55-0a83-44d1-8622-7f90af944ca6'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:30:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:47 devstack sudo[96420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:30:47 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:47 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:47 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:30:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9f771718-e175-4d31-9c86-1d9425892cb5 tempest-GroupSnapshotsTest-1083032981 None] Delete group completed successfully.
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=210,cinder:UPDATE=237,cinder:DELETE=14,cinder:INSERT=56 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=199,cinder:INSERT=62,cinder:UPDATE=245,cinder:DELETE=14 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Flow 'volume_create_manager' (26b0f082-0510-498e-960c-cb1c15e3b9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd7d52d-8563-41af-bd8b-12fa2c8bcee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd7d52d-8563-41af-bd8b-12fa2c8bcee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-13264650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83fbb6dc-437b-451b-b1d1-5c27e6c7f650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e5199818784b16812c9c6f51c5fcd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:56Z,use_quota=True,user_id='6b46195b2e954e4c83bb16a7ce6fffb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa749b4-15df-4d66-840b-0ca0709a25fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa749b4-15df-4d66-840b-0ca0709a25fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b56e04f-45f3-42ff-ac94-949e170d6ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b56e04f-45f3-42ff-ac94-949e170d6ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83fbb6dc-437b-451b-b1d1-5c27e6c7f650', 'volume_name': 'volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0b6146-b8c5-41ef-9db9-61c74d8059f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0b6146-b8c5-41ef-9db9-61c74d8059f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb64bb2f-bcc4-4d64-be10-2451e439f18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:56 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Volume 83fbb6dc-437b-451b-b1d1-5c27e6c7f650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650', 'volume_size': 1}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-13264650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83fbb6dc-437b-451b-b1d1-5c27e6c7f650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e5199818784b16812c9c6f51c5fcd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:30:56Z,use_quota=True,user_id='6b46195b2e954e4c83bb16a7ce6fffb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Creating volume 83fbb6dc-437b-451b-b1d1-5c27e6c7f650 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:30:56 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:56 devstack sudo[96466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650 1073741824
Sep 29 12:30:56 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:56 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650 1073741824" returned: 0 in 0.660s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:57 devstack sudo[96471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650
Sep 29 12:30:57 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:57 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:30:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:30:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb64bb2f-bcc4-4d64-be10-2451e439f18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e52929b-adb0-42fd-92e0-ce4585598596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:30:57 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Volume volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650 (83fbb6dc-437b-451b-b1d1-5c27e6c7f650): created successfully
Sep 29 12:30:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e52929b-adb0-42fd-92e0-ce4585598596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:30:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Flow 'volume_create_manager' (26b0f082-0510-498e-960c-cb1c15e3b9c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:30:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-09b1d96b-1f7a-406c-9208-601ff68adfed tempest-SnapshotMetadataTestJSON-1470583215 None] Created volume successfully.
Sep 29 12:30:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:30:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:30:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] Creating offline snapshot ab9cd081-eb6f-481b-a772-17d6c30471d6 of volume 83fbb6dc-437b-451b-b1d1-5c27e6c7f650 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:30:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbad869-9998-4e9c-8c14-c3604ea98e0d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:30:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:58 devstack sudo[96474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650
Sep 29 12:30:58 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-199a0a29-42f6-41d7-b883-c829e7919242 tempest-GroupSnapshotsV319Test-1624840074 None] Group tempest-GroupSnapshotsV319Test-Group-245284706: creating
Sep 29 12:30:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-199a0a29-42f6-41d7-b883-c829e7919242 tempest-GroupSnapshotsV319Test-1624840074 None] Group tempest-GroupSnapshotsV319Test-Group-245284706: created successfully
Sep 29 12:30:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-199a0a29-42f6-41d7-b883-c829e7919242 tempest-GroupSnapshotsV319Test-1624840074 None] Create group completed successfully.
Sep 29 12:30:59 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650" returned: 0 in 0.447s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:59 devstack sudo[96479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6 1G
Sep 29 12:30:59 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:30:59 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root
Sep 29 12:30:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6 1G" returned: 0 in 0.524s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:30:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:30:59 devstack sudo[96485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6
Sep 29 12:30:59 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:00 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6" returned: 0 in 0.463s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:00 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6 is being set with open permissions: ugo+rw
Sep 29 12:31:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:00 devstack sudo[96490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6
Sep 29 12:31:00 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:00 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6" returned: 0 in 0.363s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:00 devstack sudo[96493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.info
Sep 29 12:31:00 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:00 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:31:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Flow 'volume_create_manager' (4bd79191-5843-480b-a8ac-a1286f8fbafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a210fbf-d807-489b-a3f4-57104b3f227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:00 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.info" returned: 0 in 0.506s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:01 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.info is being set with open permissions: ugo+rw
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a210fbf-d807-489b-a3f4-57104b3f227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1693118054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0734b1fe-aa67-4862-928c-41540b6bcaa3,host='devstack@QuobyteHD#QuobyteHD',id=6ae6f456-884c-41b1-9e9d-050ef9689eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66493534164f4225bc4c8f452b42e5a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:01Z,use_quota=True,user_id='108c3b456815445fb8e0e872c5a6cb9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf417bc4-6544-4a97-bd1b-f6494402d61b),volume_type_id=cf417bc4-6544-4a97-bd1b-f6494402d61b)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:01 devstack sudo[96496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.info
Sep 29 12:31:01 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a40bd1e-cb7a-4626-8037-0a91447a4eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a40bd1e-cb7a-4626-8037-0a91447a4eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d02019-2a93-4269-962c-cc47dc10baac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d02019-2a93-4269-962c-cc47dc10baac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae6f456-884c-41b1-9e9d-050ef9689eb4', 'volume_name': 'volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b97362a-aa3a-4cd3-944f-aa75c1d668a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b97362a-aa3a-4cd3-944f-aa75c1d668a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c0e1e1-23b9-43a2-8f7c-2986e0c8c98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:01 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Volume 6ae6f456-884c-41b1-9e9d-050ef9689eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4', 'volume_size': 1}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:01 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.info" returned: 0 in 0.424s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.894s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.333s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0734b1fe-aa67-4862-928c-41540b6bcaa3,created_at=2026-09-29T10:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1693118054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0734b1fe-aa67-4862-928c-41540b6bcaa3,host='devstack@QuobyteHD#QuobyteHD',id=6ae6f456-884c-41b1-9e9d-050ef9689eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66493534164f4225bc4c8f452b42e5a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:01Z,use_quota=True,user_id='108c3b456815445fb8e0e872c5a6cb9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf417bc4-6544-4a97-bd1b-f6494402d61b),volume_type_id=cf417bc4-6544-4a97-bd1b-f6494402d61b)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Creating volume 6ae6f456-884c-41b1-9e9d-050ef9689eb4 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:31:01 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:31:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-470c762e-a348-4939-b6ae-3d8e97fdd8be tempest-SnapshotMetadataTestJSON-1470583215 None] Create snapshot completed successfully
Sep 29 12:31:01 devstack sudo[96499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4 1073741824
Sep 29 12:31:01 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:02 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4 1073741824" returned: 0 in 0.780s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:02 devstack sudo[96505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4
Sep 29 12:31:02 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:02 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4" returned: 0 in 0.330s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c0e1e1-23b9-43a2-8f7c-2986e0c8c98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7749333-9734-4139-9ee6-034a2a5dbce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:02 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Volume volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4 (6ae6f456-884c-41b1-9e9d-050ef9689eb4): created successfully
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7749333-9734-4139-9ee6-034a2a5dbce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Flow 'volume_create_manager' (4bd79191-5843-480b-a8ac-a1286f8fbafc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a7c43f20-54ba-4343-8153-03d32b2c2237 tempest-GroupSnapshotsV319Test-1624840074 None] Created volume successfully.
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Acquiring lock "cinder-ab9cd081-eb6f-481b-a772-17d6c30471d6-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "cinder-ab9cd081-eb6f-481b-a772-17d6c30471d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Acquiring lock "cinder-quobyte-83fbb6dc-437b-451b-b1d1-5c27e6c7f650" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "cinder-quobyte-83fbb6dc-437b-451b-b1d1-5c27e6c7f650" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Acquiring lock "cinder-quobyte-ab9cd081-eb6f-481b-a772-17d6c30471d6" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "cinder-quobyte-ab9cd081-eb6f-481b-a772-17d6c30471d6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Deleting offline snapshot ab9cd081-eb6f-481b-a772-17d6c30471d6 of volume 83fbb6dc-437b-451b-b1d1-5c27e6c7f650 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] snapshot_file for this snap is: volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[663348cd-7916-40fc-9671-e9da52cb24f2]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:03 devstack sudo[96508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6
Sep 29 12:31:03 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:03 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6" returned: 0 in 0.507s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a15ce2-c2d9-4837-9f04-812478944bab]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] GroupSnapshot acedaa9d-8278-4252-b262-d2ef2c85b796: creating.
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] Group snapshot acedaa9d-8278-4252-b262-d2ef2c85b796: creating. {{(pid=86369) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:03 devstack sudo[96515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650
Sep 29 12:31:03 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] Creating offline snapshot 2d2a40a5-cd0c-44cc-b722-042959c502e0 of volume 6ae6f456-884c-41b1-9e9d-050ef9689eb4 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d430b9e-3662-4294-af68-b907c39e2a6d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:03 devstack sudo[96517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4
Sep 29 12:31:03 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:04 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650" returned: 0 in 0.509s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:04 devstack sudo[96524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6
Sep 29 12:31:04 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:04 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4" returned: 0 in 0.530s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:04 devstack sudo[96529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0 1G
Sep 29 12:31:04 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:04 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6" returned: 0 in 0.577s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:04 devstack sudo[96538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6
Sep 29 12:31:04 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:04 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0 1G" returned: 0 in 0.569s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:04 devstack sudo[96541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0
Sep 29 12:31:04 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:05 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650.ab9cd081-eb6f-481b-a772-17d6c30471d6" returned: 0 in 0.350s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "cinder-quobyte-ab9cd081-eb6f-481b-a772-17d6c30471d6" released by "_delete_snapshot" :: held 2.121s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "cinder-quobyte-83fbb6dc-437b-451b-b1d1-5c27e6c7f650" released by "delete_snapshot" :: held 2.153s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:05 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Created reservations ['3f41518f-0a15-4acf-9764-7d842e52afef', 'e5a083f1-ffaa-4076-bb30-5d7fb2ef5903', '312735cc-f0c5-481b-a93b-873d50c78462', 'a97c5a5d-99fe-4864-8d8a-cecc420dcddc'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:05 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0" returned: 0 in 0.416s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:05 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:31:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Delete snapshot completed successfully.
Sep 29 12:31:05 devstack sudo[96548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0
Sep 29 12:31:05 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d105c2e5-330f-463a-a33e-4ff2b2c4cb53 tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "cinder-ab9cd081-eb6f-481b-a772-17d6c30471d6-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:05 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:05 devstack sudo[96551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.info
Sep 29 12:31:05 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:05 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.info" returned: 0 in 0.339s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:05 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:31:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:06 devstack sudo[96554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.info
Sep 29 12:31:06 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:06 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.info" returned: 0 in 0.304s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.551s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Acquiring lock "cinder-83fbb6dc-437b-451b-b1d1-5c27e6c7f650-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "cinder-83fbb6dc-437b-451b-b1d1-5c27e6c7f650-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Acquiring lock "cinder-quobyte-83fbb6dc-437b-451b-b1d1-5c27e6c7f650" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "cinder-quobyte-83fbb6dc-437b-451b-b1d1-5c27e6c7f650" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-50cbc9d3-9bcf-4312-99ce-117adce0f570 tempest-GroupSnapshotsV319Test-1624840074 None] group_snapshot acedaa9d-8278-4252-b262-d2ef2c85b796: created successfully
Sep 29 12:31:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6761e8-e3b9-4830-8061-4dffd9a9a6e5]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:06 devstack sudo[96557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650
Sep 29 12:31:06 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:06 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:07 devstack sudo[96562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650
Sep 29 12:31:07 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:07 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-83fbb6dc-437b-451b-b1d1-5c27e6c7f650" returned: 0 in 0.455s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "cinder-quobyte-83fbb6dc-437b-451b-b1d1-5c27e6c7f650" released by "delete_volume" :: held 1.044s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Created reservations ['2b02ee2d-87a7-4f47-b678-f523a357e27f', '65e73d8c-f913-444b-9544-90b385e6e66e', 'f5b4d0e1-6133-4b7e-9579-cccd673e6828', 'ad9ef071-b217-4605-a926-86c9d3e48af7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] group_snapshot acedaa9d-8278-4252-b262-d2ef2c85b796: deleting
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] group_snapshot acedaa9d-8278-4252-b262-d2ef2c85b796: deleting {{(pid=86369) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Acquiring lock "cinder-quobyte-6ae6f456-884c-41b1-9e9d-050ef9689eb4" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "cinder-quobyte-6ae6f456-884c-41b1-9e9d-050ef9689eb4" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Acquiring lock "cinder-quobyte-2d2a40a5-cd0c-44cc-b722-042959c502e0" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:07 devstack sudo[96567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:31:07 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "cinder-quobyte-2d2a40a5-cd0c-44cc-b722-042959c502e0" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Deleting offline snapshot 2d2a40a5-cd0c-44cc-b722-042959c502e0 of volume 6ae6f456-884c-41b1-9e9d-050ef9689eb4 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] snapshot_file for this snap is: volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36c69ae-750b-4ca8-9402-4fd7878e3bfc]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:07 devstack sudo[96569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:31:07 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:08 devstack sudo[96571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0
Sep 29 12:31:08 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:08 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:08 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.399s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:31:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.532s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:31:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:31:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 28 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:31:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:31:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Deleted volume successfully.
Sep 29 12:31:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4cd535d4-b6e5-42a3-a89f-ed7ee90219d8 tempest-SnapshotMetadataTestJSON-1470583215 None] Lock "cinder-83fbb6dc-437b-451b-b1d1-5c27e6c7f650-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:08 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0" returned: 0 in 0.517s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:31:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7589f1-06d6-4014-a549-64301e42d64b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:08 devstack sudo[96578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4
Sep 29 12:31:08 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:09 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4" returned: 0 in 0.632s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:09 devstack sudo[96584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0
Sep 29 12:31:09 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:09 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0" returned: 0 in 0.535s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:09 devstack sudo[96590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0
Sep 29 12:31:09 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:09 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4.2d2a40a5-cd0c-44cc-b722-042959c502e0" returned: 0 in 0.358s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "cinder-quobyte-2d2a40a5-cd0c-44cc-b722-042959c502e0" released by "_delete_snapshot" :: held 2.267s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "cinder-quobyte-6ae6f456-884c-41b1-9e9d-050ef9689eb4" released by "delete_snapshot" :: held 2.329s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:10 devstack cinder-volume[86369]: WARNING cinder.quota [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-882081133 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-882081133, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:31:10 devstack cinder-volume[86369]: WARNING cinder.quota [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-882081133 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-882081133, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] Created reservations ['de7b88b4-7bca-4ad5-8c75-3c1a2f7d86e8', '85523458-d916-4e55-a99d-ab6f8694061c', '6bf27f4a-c783-4271-b2c3-5190393ffed8', '593c87ce-6e99-4732-9fe0-a2e40b1efb66'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6d168e8c-015b-4ef4-a32c-107db4f83c31 tempest-GroupSnapshotsV319Test-1624840074 None] group_snapshot acedaa9d-8278-4252-b262-d2ef2c85b796: deleted successfully
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Flow 'volume_create_manager' (414186b0-aa35-492c-ab90-069b03411f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edecfad5-ae5c-4745-b822-df847dc63cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edecfad5-ae5c-4745-b822-df847dc63cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1316041876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be055b37-864e-4421-9377-f6c3553c5048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085e100ee4c04d338c3bd38097d07864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:11Z,use_quota=True,user_id='f5a5e6e86187490eb46e45cf9fe24675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55c77d20-21d0-4911-a88d-f0f1e08097b3),volume_type_id=55c77d20-21d0-4911-a88d-f0f1e08097b3)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a9f90e-febd-4e19-84ec-978c4688122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a9f90e-febd-4e19-84ec-978c4688122b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d306e68-094f-4aef-8183-47a6e7689c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d306e68-094f-4aef-8183-47a6e7689c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be055b37-864e-4421-9377-f6c3553c5048', 'volume_name': 'volume-be055b37-864e-4421-9377-f6c3553c5048', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23de7674-d03c-4eb4-bb5a-2014a0f82afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23de7674-d03c-4eb4-bb5a-2014a0f82afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c42e08-256e-49df-8e21-3bc17b65a152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:10 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Volume be055b37-864e-4421-9377-f6c3553c5048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be055b37-864e-4421-9377-f6c3553c5048', 'volume_size': 1}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1316041876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be055b37-864e-4421-9377-f6c3553c5048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085e100ee4c04d338c3bd38097d07864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:11Z,use_quota=True,user_id='f5a5e6e86187490eb46e45cf9fe24675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55c77d20-21d0-4911-a88d-f0f1e08097b3),volume_type_id=55c77d20-21d0-4911-a88d-f0f1e08097b3)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Creating volume be055b37-864e-4421-9377-f6c3553c5048 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:31:11 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:31:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-be055b37-864e-4421-9377-f6c3553c5048 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:11 devstack sudo[96593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-be055b37-864e-4421-9377-f6c3553c5048 1073741824
Sep 29 12:31:11 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Acquiring lock "cinder-quobyte-6ae6f456-884c-41b1-9e9d-050ef9689eb4" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "cinder-quobyte-6ae6f456-884c-41b1-9e9d-050ef9689eb4" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[668dcf48-de35-47a6-89ec-eb94db33e48c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:11 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-be055b37-864e-4421-9377-f6c3553c5048 1073741824" returned: 0 in 0.766s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-be055b37-864e-4421-9377-f6c3553c5048 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:11 devstack sudo[96602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-be055b37-864e-4421-9377-f6c3553c5048
Sep 29 12:31:11 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:11 devstack sudo[96601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4
Sep 29 12:31:11 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:12 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-be055b37-864e-4421-9377-f6c3553c5048" returned: 0 in 0.435s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c42e08-256e-49df-8e21-3bc17b65a152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be055b37-864e-4421-9377-f6c3553c5048', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef12ab8-7874-453d-8b32-482d2002967a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Volume volume-be055b37-864e-4421-9377-f6c3553c5048 (be055b37-864e-4421-9377-f6c3553c5048): created successfully
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef12ab8-7874-453d-8b32-482d2002967a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:12 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Flow 'volume_create_manager' (414186b0-aa35-492c-ab90-069b03411f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4" returned: 0 in 0.694s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-07719c89-53bd-43e5-b443-0c25a460fd37 tempest-VolumeTypesAccessTest-2021482160 None] Created volume successfully.
Sep 29 12:31:12 devstack sudo[96609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4
Sep 29 12:31:12 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:12 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6ae6f456-884c-41b1-9e9d-050ef9689eb4" returned: 0 in 0.338s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "cinder-quobyte-6ae6f456-884c-41b1-9e9d-050ef9689eb4" released by "delete_volume" :: held 1.155s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Created reservations ['dd0c82cd-bb8a-42e8-9e5b-f79f77946485'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:12 devstack cinder-volume[86369]: WARNING cinder.quota [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-882081133 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-882081133, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:31:12 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Created reservations ['6858a031-769b-42e0-a913-cc069673d9c4', '0b4df2f4-9819-492c-b46e-d0a151a9d6e5', '8d69a30e-1fbf-40c3-a672-a798d0b38164', 'd4d44597-d6b7-4c0f-b3ba-6a77ab355336'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:13 devstack sudo[96612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:31:13 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Acquiring lock "cinder-be055b37-864e-4421-9377-f6c3553c5048-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Lock "cinder-be055b37-864e-4421-9377-f6c3553c5048-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Acquiring lock "cinder-quobyte-be055b37-864e-4421-9377-f6c3553c5048" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Lock "cinder-quobyte-be055b37-864e-4421-9377-f6c3553c5048" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd68cc2-3772-41a6-ad68-4ef83df3f6f2]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-be055b37-864e-4421-9377-f6c3553c5048 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:13 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.402s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:31:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-eb73af61-5860-4057-b8ad-a8de48ee5e22 tempest-GroupSnapshotsV319Test-1624840074 None] Delete group completed successfully.
Sep 29 12:31:13 devstack sudo[96615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-be055b37-864e-4421-9377-f6c3553c5048
Sep 29 12:31:13 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:13 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-be055b37-864e-4421-9377-f6c3553c5048" returned: 0 in 0.480s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-be055b37-864e-4421-9377-f6c3553c5048 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:14 devstack sudo[96621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-be055b37-864e-4421-9377-f6c3553c5048
Sep 29 12:31:14 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:14 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-be055b37-864e-4421-9377-f6c3553c5048" returned: 0 in 0.329s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Lock "cinder-quobyte-be055b37-864e-4421-9377-f6c3553c5048" released by "delete_volume" :: held 0.884s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:14 devstack cinder-volume[86369]: WARNING cinder.quota [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-220887354 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-220887354, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:31:14 devstack cinder-volume[86369]: WARNING cinder.quota [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-220887354 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-220887354, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:31:14 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Created reservations ['ee946e09-b748-43de-b8a4-4335194498ae', '8fbd5482-3ece-4b3d-a6bb-8d42770e4f89', '425688eb-4911-4c4e-9b9b-d37362d25cc3', '6e25ec55-965d-48e2-87ce-522b4c60f9d5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:14 devstack sudo[96624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:31:14 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:15 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.543s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:15 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:31:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Deleted volume successfully.
Sep 29 12:31:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aa7f794b-5fa7-4976-8ef0-74719d31a939 tempest-VolumeTypesAccessTest-2021482160 None] Lock "cinder-be055b37-864e-4421-9377-f6c3553c5048-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Flow 'volume_create_manager' (c846982e-da15-4a86-99ed-69e54bed08f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6c8f57-85d2-49e0-9a18-67562f61fdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6c8f57-85d2-49e0-9a18-67562f61fdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1087233129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0849b7-dcdd-4d9d-8b2e-7d1500178e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9143b83a8e404ea78091795e9af1944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:22Z,use_quota=True,user_id='e70a72108299471fb24e4e3bf108da2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a47be4-d2b9-4a47-a404-24b48d16719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a47be4-d2b9-4a47-a404-24b48d16719d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdbddd79-03bf-4ed1-bf7f-e685f85de827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdbddd79-03bf-4ed1-bf7f-e685f85de827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d0849b7-dcdd-4d9d-8b2e-7d1500178e34', 'volume_name': 'volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd56532e-9822-4ccc-b827-2dfebec13679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd56532e-9822-4ccc-b827-2dfebec13679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad24c52-a0f2-43ca-a669-222cad12cfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Volume 4d0849b7-dcdd-4d9d-8b2e-7d1500178e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34', 'volume_size': 1}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1087233129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0849b7-dcdd-4d9d-8b2e-7d1500178e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9143b83a8e404ea78091795e9af1944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:22Z,use_quota=True,user_id='e70a72108299471fb24e4e3bf108da2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Creating volume 4d0849b7-dcdd-4d9d-8b2e-7d1500178e34 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:31:21 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:31:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:21 devstack sudo[96627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34 1073741824
Sep 29 12:31:21 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:22 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34 1073741824" returned: 0 in 0.653s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:22 devstack sudo[96633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34
Sep 29 12:31:22 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:22 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34" returned: 0 in 0.309s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:31:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad24c52-a0f2-43ca-a669-222cad12cfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54e6315-3dc1-40c8-a344-58fe705b1ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:22 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Volume volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34 (4d0849b7-dcdd-4d9d-8b2e-7d1500178e34): created successfully
Sep 29 12:31:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54e6315-3dc1-40c8-a344-58fe705b1ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Flow 'volume_create_manager' (c846982e-da15-4a86-99ed-69e54bed08f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4bbef468-0e8d-42ae-95de-46bd31c77df0 tempest-VolumesTransfersTest-496572402 None] Created volume successfully.
Sep 29 12:31:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a96174ed-5461-4e07-923f-011f4d6dbcd0 tempest-VolumesTransfersTest-1178751288 None] Transfer volume completed successfully.
Sep 29 12:31:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Acquiring lock "cinder-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Lock "cinder-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Acquiring lock "cinder-quobyte-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Lock "cinder-quobyte-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2d761a-587e-4ff8-887e-bcf9c9b8c1ce]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:26 devstack sudo[96640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34
Sep 29 12:31:26 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:27 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34" returned: 0 in 0.599s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:27 devstack sudo[96659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34
Sep 29 12:31:27 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:27 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34" returned: 0 in 0.399s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Lock "cinder-quobyte-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34" released by "delete_volume" :: held 1.087s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:27 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Created reservations ['7e6ca9c2-b08d-4b93-b467-88d5bef5c557', 'a22888e4-c7b2-4b51-aa09-4b0ee02dcf29', 'a00449fe-f726-4c81-92ac-42025a2cfe21', '9aa1dde5-21ce-4b77-9741-150ae3499264'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:28 devstack sudo[96669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:31:28 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:28 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.318s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:28 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:31:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Deleted volume successfully.
Sep 29 12:31:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7aa8f20f-787f-4b76-bb5b-7c67d332d0d7 tempest-VolumesTransfersTest-636839239 None] Lock "cinder-4d0849b7-dcdd-4d9d-8b2e-7d1500178e34-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Flow 'volume_create_manager' (50813653-d6a9-4040-869c-51a28567f04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461d9301-a79f-4538-bcca-a4a06d24c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461d9301-a79f-4538-bcca-a4a06d24c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1998839613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc99908c-a9e2-42ea-a180-240ad45b8ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9143b83a8e404ea78091795e9af1944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:30Z,use_quota=True,user_id='e70a72108299471fb24e4e3bf108da2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765d6b35-a5bd-44a1-890a-03228e5db5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765d6b35-a5bd-44a1-890a-03228e5db5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ba1305-a68a-4ebe-b519-fa2241c7f697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ba1305-a68a-4ebe-b519-fa2241c7f697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc99908c-a9e2-42ea-a180-240ad45b8ce7', 'volume_name': 'volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cad84c-7a0d-4173-a40e-12b5144ce5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cad84c-7a0d-4173-a40e-12b5144ce5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be75d51-8204-4424-98aa-e905f5f106a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:29 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Volume cc99908c-a9e2-42ea-a180-240ad45b8ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7', 'volume_size': 1}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1998839613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc99908c-a9e2-42ea-a180-240ad45b8ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9143b83a8e404ea78091795e9af1944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:30Z,use_quota=True,user_id='e70a72108299471fb24e4e3bf108da2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:31:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Creating volume cc99908c-a9e2-42ea-a180-240ad45b8ce7 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:31:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:31:30 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:31:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:30 devstack sudo[96699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7 1073741824
Sep 29 12:31:30 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:31 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7 1073741824" returned: 0 in 1.000s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:31 devstack sudo[96750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7
Sep 29 12:31:31 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:31 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:31:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be75d51-8204-4424-98aa-e905f5f106a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d623c74b-b0ca-43af-9613-d1f368e7c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:31 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Volume volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7 (cc99908c-a9e2-42ea-a180-240ad45b8ce7): created successfully
Sep 29 12:31:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d623c74b-b0ca-43af-9613-d1f368e7c69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Flow 'volume_create_manager' (50813653-d6a9-4040-869c-51a28567f04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e5b0f539-1275-42a0-8304-3278385bec81 tempest-VolumesTransfersTest-496572402 None] Created volume successfully.
Sep 29 12:31:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Acquiring lock "cinder-cc99908c-a9e2-42ea-a180-240ad45b8ce7-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Lock "cinder-cc99908c-a9e2-42ea-a180-240ad45b8ce7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Acquiring lock "cinder-quobyte-cc99908c-a9e2-42ea-a180-240ad45b8ce7" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Lock "cinder-quobyte-cc99908c-a9e2-42ea-a180-240ad45b8ce7" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[130d6c46-d11d-4acb-a120-9182592dde69]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:32 devstack sudo[96779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7
Sep 29 12:31:32 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:33 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7" returned: 0 in 0.562s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:33 devstack sudo[96786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7
Sep 29 12:31:33 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:33 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc99908c-a9e2-42ea-a180-240ad45b8ce7" returned: 0 in 0.356s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Lock "cinder-quobyte-cc99908c-a9e2-42ea-a180-240ad45b8ce7" released by "delete_volume" :: held 1.011s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:33 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Created reservations ['9796a76f-c5d6-4d13-b989-80fff20c3be8', '43c7431c-4247-4d3a-bbb2-95e765f72631', '1960aede-e824-4967-b44c-72d16c45c7ad', 'd1089d73-0170-474d-afeb-ce6254ad8d5b'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:33 devstack sudo[96789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:31:33 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:34 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.450s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:34 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:31:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Deleted volume successfully.
Sep 29 12:31:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6a043af5-9ccb-4398-806e-9d57089d694a tempest-VolumesTransfersTest-636839239 None] Lock "cinder-cc99908c-a9e2-42ea-a180-240ad45b8ce7-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1d3effd2-a3cd-4448-8245-e5c702ac1c29 tempest-GroupsTest-972885595 None] Group tempest-Group1-421614380: creating
Sep 29 12:31:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1d3effd2-a3cd-4448-8245-e5c702ac1c29 tempest-GroupsTest-972885595 None] Group tempest-Group1-421614380: created successfully
Sep 29 12:31:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1d3effd2-a3cd-4448-8245-e5c702ac1c29 tempest-GroupsTest-972885595 None] Create group completed successfully.
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Flow 'volume_create_manager' (0dd9a0ce-ba4c-48d9-9201-04f907544269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fcf9bd-8543-49b1-acd7-d7db72d681e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fcf9bd-8543-49b1-acd7-d7db72d681e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1713381814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d31537-e024-4c53-ae0d-1f7a8029869f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51a3b3011be41b8a2677d72dbded921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:36Z,use_quota=True,user_id='f4f7e61073a048b0ad38c5ba55a26392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2198fc-b893-4e6a-ae09-62a2d10eff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2198fc-b893-4e6a-ae09-62a2d10eff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953f2844-1df8-4ae4-b175-f493fa07c3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953f2844-1df8-4ae4-b175-f493fa07c3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d31537-e024-4c53-ae0d-1f7a8029869f', 'volume_name': 'volume-84d31537-e024-4c53-ae0d-1f7a8029869f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da80e302-b073-41eb-95e6-4ffc0c04d73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da80e302-b073-41eb-95e6-4ffc0c04d73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b20739-3ae2-4625-b2c1-cbc6332277ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Volume 84d31537-e024-4c53-ae0d-1f7a8029869f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d31537-e024-4c53-ae0d-1f7a8029869f', 'volume_size': 1}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1713381814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d31537-e024-4c53-ae0d-1f7a8029869f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51a3b3011be41b8a2677d72dbded921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:36Z,use_quota=True,user_id='f4f7e61073a048b0ad38c5ba55a26392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Creating volume 84d31537-e024-4c53-ae0d-1f7a8029869f {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:31:36 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-84d31537-e024-4c53-ae0d-1f7a8029869f 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a392d90a-0306-475a-adb8-c0b4655e6c13 tempest-GroupsTest-972885595 None] Group tempest-Group2-5359278: creating
Sep 29 12:31:36 devstack sudo[96795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-84d31537-e024-4c53-ae0d-1f7a8029869f 1073741824
Sep 29 12:31:36 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a392d90a-0306-475a-adb8-c0b4655e6c13 tempest-GroupsTest-972885595 None] Group tempest-Group2-5359278: created successfully
Sep 29 12:31:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a392d90a-0306-475a-adb8-c0b4655e6c13 tempest-GroupsTest-972885595 None] Create group completed successfully.
Sep 29 12:31:36 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-84d31537-e024-4c53-ae0d-1f7a8029869f 1073741824" returned: 0 in 0.539s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-84d31537-e024-4c53-ae0d-1f7a8029869f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:37 devstack sudo[96801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-84d31537-e024-4c53-ae0d-1f7a8029869f
Sep 29 12:31:37 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Flow 'volume_create_manager' (1a14d6f7-9d52-485f-bb67-c6817bc4c2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad1cb17-b126-4b8b-8f4c-cb08a1dff35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:37 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad1cb17-b126-4b8b-8f4c-cb08a1dff35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-67963872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b8408c-7e77-47bb-a959-f6fe703046a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e6707dcf2c64e15afcc8f59810cddd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:37Z,use_quota=True,user_id='35b79f10140c404eb1c961f0ae11d62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435f160f-4edf-4742-83df-647013bcfe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435f160f-4edf-4742-83df-647013bcfe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b8ec46-86ac-413b-be9a-afd905830166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b8ec46-86ac-413b-be9a-afd905830166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b8408c-7e77-47bb-a959-f6fe703046a0', 'volume_name': 'volume-43b8408c-7e77-47bb-a959-f6fe703046a0', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48eaa30-1051-41f0-adcc-58dbe16c3b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48eaa30-1051-41f0-adcc-58dbe16c3b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec752b5e-82cb-4c68-8b81-febeca40c292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:37 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Volume 43b8408c-7e77-47bb-a959-f6fe703046a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b8408c-7e77-47bb-a959-f6fe703046a0', 'volume_size': 1}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-84d31537-e024-4c53-ae0d-1f7a8029869f" returned: 0 in 0.543s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-67963872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b8408c-7e77-47bb-a959-f6fe703046a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e6707dcf2c64e15afcc8f59810cddd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:37Z,use_quota=True,user_id='35b79f10140c404eb1c961f0ae11d62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Creating volume 43b8408c-7e77-47bb-a959-f6fe703046a0 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:31:37 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-43b8408c-7e77-47bb-a959-f6fe703046a0 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b20739-3ae2-4625-b2c1-cbc6332277ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d31537-e024-4c53-ae0d-1f7a8029869f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:37 devstack sudo[96804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-43b8408c-7e77-47bb-a959-f6fe703046a0 1073741824
Sep 29 12:31:37 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9ad867-e4d8-4343-b78c-a60eff34ff74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:37 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Volume volume-84d31537-e024-4c53-ae0d-1f7a8029869f (84d31537-e024-4c53-ae0d-1f7a8029869f): created successfully
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9ad867-e4d8-4343-b78c-a60eff34ff74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Flow 'volume_create_manager' (0dd9a0ce-ba4c-48d9-9201-04f907544269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c3fcce6e-c25b-42cd-a944-3aafbffbde6a tempest-TestMinimumBasicScenario-1819074765 None] Created volume successfully.
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Flow 'volume_create_manager' (4041d8f5-3749-4b1c-a44d-66f79bd45b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b729e7-ff64-4bfe-aac8-000e701343bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b729e7-ff64-4bfe-aac8-000e701343bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-141107294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e2becaaf-63d1-44e2-a815-3db7f0ddb6bb,host='devstack@QuobyteHD#QuobyteHD',id=900cd52e-c70d-4fd9-979b-90033115c71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3cbbc5f35f47909b86a1aaa299aab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:38Z,use_quota=True,user_id='b8aa3813a20f482c91514298f67e5d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dae30e8-2c97-450f-9de5-b082bbae0246),volume_type_id=2dae30e8-2c97-450f-9de5-b082bbae0246)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179a4cdd-c21e-4aaa-9e6d-1b61fee4f279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179a4cdd-c21e-4aaa-9e6d-1b61fee4f279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee99068-f6bf-437b-98a5-bf28abdfa654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee99068-f6bf-437b-98a5-bf28abdfa654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '900cd52e-c70d-4fd9-979b-90033115c71e', 'volume_name': 'volume-900cd52e-c70d-4fd9-979b-90033115c71e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f31c188-f694-43b9-a153-6d35b1192c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f31c188-f694-43b9-a153-6d35b1192c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edae247-df38-4cbc-a8e6-be8a11a11c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:38 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Volume 900cd52e-c70d-4fd9-979b-90033115c71e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-900cd52e-c70d-4fd9-979b-90033115c71e', 'volume_size': 1}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:38 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-43b8408c-7e77-47bb-a959-f6fe703046a0 1073741824" returned: 0 in 0.846s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-43b8408c-7e77-47bb-a959-f6fe703046a0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:38 devstack sudo[96809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-43b8408c-7e77-47bb-a959-f6fe703046a0
Sep 29 12:31:38 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:38 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-43b8408c-7e77-47bb-a959-f6fe703046a0" returned: 0 in 0.287s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.421s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e2becaaf-63d1-44e2-a815-3db7f0ddb6bb,created_at=2026-09-29T10:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-141107294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e2becaaf-63d1-44e2-a815-3db7f0ddb6bb,host='devstack@QuobyteHD#QuobyteHD',id=900cd52e-c70d-4fd9-979b-90033115c71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3cbbc5f35f47909b86a1aaa299aab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:38Z,use_quota=True,user_id='b8aa3813a20f482c91514298f67e5d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dae30e8-2c97-450f-9de5-b082bbae0246),volume_type_id=2dae30e8-2c97-450f-9de5-b082bbae0246)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Creating volume 900cd52e-c70d-4fd9-979b-90033115c71e {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:31:38 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-900cd52e-c70d-4fd9-979b-90033115c71e 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec752b5e-82cb-4c68-8b81-febeca40c292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b8408c-7e77-47bb-a959-f6fe703046a0', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:38 devstack sudo[96815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-900cd52e-c70d-4fd9-979b-90033115c71e 1073741824
Sep 29 12:31:38 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a98b13-a1a6-431c-9c36-e4f99c86eaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:38 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Volume volume-43b8408c-7e77-47bb-a959-f6fe703046a0 (43b8408c-7e77-47bb-a959-f6fe703046a0): created successfully
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a98b13-a1a6-431c-9c36-e4f99c86eaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Flow 'volume_create_manager' (1a14d6f7-9d52-485f-bb67-c6817bc4c2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c6d6e98b-5f8b-41bb-8245-47b106321692 tempest-AbsoluteLimitsTests-1326820887 None] Created volume successfully.
Sep 29 12:31:39 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-900cd52e-c70d-4fd9-979b-90033115c71e 1073741824" returned: 0 in 0.589s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-900cd52e-c70d-4fd9-979b-90033115c71e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:39 devstack sudo[96821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-900cd52e-c70d-4fd9-979b-90033115c71e
Sep 29 12:31:39 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:39 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-900cd52e-c70d-4fd9-979b-90033115c71e" returned: 0 in 0.456s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:31:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edae247-df38-4cbc-a8e6-be8a11a11c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-900cd52e-c70d-4fd9-979b-90033115c71e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea57b09-1daa-477a-95ca-b19b8feeb0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:39 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Volume volume-900cd52e-c70d-4fd9-979b-90033115c71e (900cd52e-c70d-4fd9-979b-90033115c71e): created successfully
Sep 29 12:31:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea57b09-1daa-477a-95ca-b19b8feeb0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Flow 'volume_create_manager' (4041d8f5-3749-4b1c-a44d-66f79bd45b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c58f7700-cd27-4a94-9397-0e4679f9e12d tempest-GroupsTest-972885595 None] Created volume successfully.
Sep 29 12:31:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Acquiring lock "cinder-43b8408c-7e77-47bb-a959-f6fe703046a0-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Lock "cinder-43b8408c-7e77-47bb-a959-f6fe703046a0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-335cc7e6-ca02-4ad7-831d-85ede1d41f6f req-ffb76190-3f32-4ea7-b8a1-e966aea568ba tempest-TestMinimumBasicScenario-1819074765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-335cc7e6-ca02-4ad7-831d-85ede1d41f6f req-ffb76190-3f32-4ea7-b8a1-e966aea568ba tempest-TestMinimumBasicScenario-1819074765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-335cc7e6-ca02-4ad7-831d-85ede1d41f6f req-ffb76190-3f32-4ea7-b8a1-e966aea568ba tempest-TestMinimumBasicScenario-1819074765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Acquiring lock "cinder-quobyte-43b8408c-7e77-47bb-a959-f6fe703046a0" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Lock "cinder-quobyte-43b8408c-7e77-47bb-a959-f6fe703046a0" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-335cc7e6-ca02-4ad7-831d-85ede1d41f6f req-ffb76190-3f32-4ea7-b8a1-e966aea568ba tempest-TestMinimumBasicScenario-1819074765 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-84d31537-e024-4c53-ae0d-1f7a8029869f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1dfa943e-6ced-4cf9-a612-1006b7cf8f8b', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:31:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[475006a6-76bd-4b51-977e-9864ecc098fc]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-43b8408c-7e77-47bb-a959-f6fe703046a0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-335cc7e6-ca02-4ad7-831d-85ede1d41f6f req-ffb76190-3f32-4ea7-b8a1-e966aea568ba tempest-TestMinimumBasicScenario-1819074765 None] attachment_update completed successfully.
Sep 29 12:31:40 devstack sudo[96832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-43b8408c-7e77-47bb-a959-f6fe703046a0
Sep 29 12:31:40 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:41 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-43b8408c-7e77-47bb-a959-f6fe703046a0" returned: 0 in 0.902s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-43b8408c-7e77-47bb-a959-f6fe703046a0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:41 devstack sudo[97251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-43b8408c-7e77-47bb-a959-f6fe703046a0
Sep 29 12:31:41 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:41 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-43b8408c-7e77-47bb-a959-f6fe703046a0" returned: 0 in 0.369s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Lock "cinder-quobyte-43b8408c-7e77-47bb-a959-f6fe703046a0" released by "delete_volume" :: held 1.379s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:41 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Created reservations ['a73e9359-d9f3-478b-9b3f-5e4572e3671f', 'e4591613-08c2-4450-970c-2da0321dea3a', '8412d001-1ecb-4eb2-9b34-caceaea56e1e', '7107b96d-4a85-4c7a-96aa-f07b1da659fb'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Acquiring lock "cinder-quobyte-900cd52e-c70d-4fd9-979b-90033115c71e" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Lock "cinder-quobyte-900cd52e-c70d-4fd9-979b-90033115c71e" acquired by "delete_volume" :: waited 0.107s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b9917-ac14-4c9f-93fa-6fac5d530626]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-900cd52e-c70d-4fd9-979b-90033115c71e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:42 devstack sudo[97259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:31:42 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:42 devstack sudo[97258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-900cd52e-c70d-4fd9-979b-90033115c71e
Sep 29 12:31:42 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:42 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.444s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:31:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Deleted volume successfully.
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d854c963-770e-47a5-97d1-5b2658de8992 tempest-AbsoluteLimitsTests-1326820887 None] Lock "cinder-43b8408c-7e77-47bb-a959-f6fe703046a0-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:42 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-900cd52e-c70d-4fd9-979b-90033115c71e" returned: 0 in 0.567s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-900cd52e-c70d-4fd9-979b-90033115c71e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:42 devstack sudo[97266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-900cd52e-c70d-4fd9-979b-90033115c71e
Sep 29 12:31:42 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:42 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-900cd52e-c70d-4fd9-979b-90033115c71e" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Lock "cinder-quobyte-900cd52e-c70d-4fd9-979b-90033115c71e" released by "delete_volume" :: held 1.052s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:43 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Created reservations ['f20f9aa5-1a2e-4c5f-8f4d-000d89550759'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:43 devstack cinder-volume[86369]: WARNING cinder.quota [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-151264603 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-151264603, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:31:43 devstack cinder-volume[86369]: WARNING cinder.quota [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-151264603 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-151264603, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:31:43 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Created reservations ['2fc85e77-3f75-471c-b8f1-be82cfdafd15', '04645778-f59d-42ff-82b5-c42adfcfd438', 'dd12ddbe-f6b4-48b5-992d-b2ef26284002', '98d64b6d-e0fd-4397-b332-5ccda55a7601'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:43 devstack sudo[97269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:31:43 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:43 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.370s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:43 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:31:43 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6c124bde-1fc4-4c71-bb3f-03b8d0c1f8c5 tempest-GroupsTest-972885595 None] Delete group completed successfully.
Sep 29 12:31:44 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c6edb96f-19b1-4027-a57f-4b99d443e8ab tempest-GroupsTest-972885595 None] Created reservations ['7917873a-9f2d-4cb8-8584-71b9e06beee1'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6edb96f-19b1-4027-a57f-4b99d443e8ab tempest-GroupsTest-972885595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6edb96f-19b1-4027-a57f-4b99d443e8ab tempest-GroupsTest-972885595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6edb96f-19b1-4027-a57f-4b99d443e8ab tempest-GroupsTest-972885595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6edb96f-19b1-4027-a57f-4b99d443e8ab tempest-GroupsTest-972885595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6edb96f-19b1-4027-a57f-4b99d443e8ab tempest-GroupsTest-972885595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6edb96f-19b1-4027-a57f-4b99d443e8ab tempest-GroupsTest-972885595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:45 devstack sudo[97273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:31:45 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:45 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6edb96f-19b1-4027-a57f-4b99d443e8ab tempest-GroupsTest-972885595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.368s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:45 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c6edb96f-19b1-4027-a57f-4b99d443e8ab tempest-GroupsTest-972885595 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:31:45 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c6edb96f-19b1-4027-a57f-4b99d443e8ab tempest-GroupsTest-972885595 None] Delete group completed successfully.
Sep 29 12:31:46 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3db06ac4-fdb7-4c9e-82c0-026643ef1118 tempest-GroupsTest-972885595 None] Group tempest-GroupsTest-Group-1455532063: creating
Sep 29 12:31:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3db06ac4-fdb7-4c9e-82c0-026643ef1118 tempest-GroupsTest-972885595 None] Group tempest-GroupsTest-Group-1455532063: created successfully
Sep 29 12:31:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3db06ac4-fdb7-4c9e-82c0-026643ef1118 tempest-GroupsTest-972885595 None] Create group completed successfully.
Sep 29 12:31:48 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:31:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Flow 'volume_create_manager' (d3119295-c04b-46ef-bb7a-9e61596a175f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45847a67-7d95-4a8e-8f75-1ceff29be151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45847a67-7d95-4a8e-8f75-1ceff29be151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1476823135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a44c37ad-2da7-49f6-b986-bfcb79e526c0,host='devstack@QuobyteHD#QuobyteHD',id=92d95105-d98c-4712-9287-2c28db2f7800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3cbbc5f35f47909b86a1aaa299aab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:49Z,use_quota=True,user_id='b8aa3813a20f482c91514298f67e5d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1342317c-68ec-4cb5-9551-dfb7642ec85a),volume_type_id=1342317c-68ec-4cb5-9551-dfb7642ec85a)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc462737-6282-4f3d-868c-60488f54c5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc462737-6282-4f3d-868c-60488f54c5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5edfc9-9c1f-4abd-a931-647cb3952109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5edfc9-9c1f-4abd-a931-647cb3952109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92d95105-d98c-4712-9287-2c28db2f7800', 'volume_name': 'volume-92d95105-d98c-4712-9287-2c28db2f7800', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98345efe-a486-4e3f-a885-e2e0109c2b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98345efe-a486-4e3f-a885-e2e0109c2b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9743ff0e-9c1b-4f1e-ba7c-874c4b4a8a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Volume 92d95105-d98c-4712-9287-2c28db2f7800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92d95105-d98c-4712-9287-2c28db2f7800', 'volume_size': 1}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a44c37ad-2da7-49f6-b986-bfcb79e526c0,created_at=2026-09-29T10:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1476823135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a44c37ad-2da7-49f6-b986-bfcb79e526c0,host='devstack@QuobyteHD#QuobyteHD',id=92d95105-d98c-4712-9287-2c28db2f7800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3cbbc5f35f47909b86a1aaa299aab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:49Z,use_quota=True,user_id='b8aa3813a20f482c91514298f67e5d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1342317c-68ec-4cb5-9551-dfb7642ec85a),volume_type_id=1342317c-68ec-4cb5-9551-dfb7642ec85a)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Creating volume 92d95105-d98c-4712-9287-2c28db2f7800 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:31:49 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92d95105-d98c-4712-9287-2c28db2f7800 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:49 devstack sudo[97297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92d95105-d98c-4712-9287-2c28db2f7800 1073741824
Sep 29 12:31:49 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:49 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92d95105-d98c-4712-9287-2c28db2f7800 1073741824" returned: 0 in 0.646s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92d95105-d98c-4712-9287-2c28db2f7800 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:49 devstack sudo[97339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92d95105-d98c-4712-9287-2c28db2f7800
Sep 29 12:31:49 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Flow 'volume_create_manager' (08687779-5eb8-4d52-b7c8-cc092424bfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fd87be-c1bd-4db4-9c66-2dd6a92b9cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fd87be-c1bd-4db4-9c66-2dd6a92b9cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-597807572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0147b0-a0a8-4a67-bf1b-7bea53ab559a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e71a5c53ff34cb8a41c6e8311e577a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:50Z,use_quota=True,user_id='fc4248507d1c4682a935dbb49e7275b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e05b7d-fd93-4fce-b902-e972d0353d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e05b7d-fd93-4fce-b902-e972d0353d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bb3174-4f6a-4c7d-919b-af9a9ee93372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bb3174-4f6a-4c7d-919b-af9a9ee93372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b0147b0-a0a8-4a67-bf1b-7bea53ab559a', 'volume_name': 'volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8d52f2-209f-4b00-944e-a8db698334b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8d52f2-209f-4b00-944e-a8db698334b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d7c436-cc6c-41c4-b5ff-d960bd578af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:50 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Volume 2b0147b0-a0a8-4a67-bf1b-7bea53ab559a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a', 'volume_size': 1}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:50 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92d95105-d98c-4712-9287-2c28db2f7800" returned: 0 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.025s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-597807572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0147b0-a0a8-4a67-bf1b-7bea53ab559a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e71a5c53ff34cb8a41c6e8311e577a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:50Z,use_quota=True,user_id='fc4248507d1c4682a935dbb49e7275b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Creating volume 2b0147b0-a0a8-4a67-bf1b-7bea53ab559a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:31:50 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9743ff0e-9c1b-4f1e-ba7c-874c4b4a8a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d95105-d98c-4712-9287-2c28db2f7800', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:50 devstack sudo[97342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a 1073741824
Sep 29 12:31:50 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274c71c8-887c-46db-9c41-ce33b29e19ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:50 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Volume volume-92d95105-d98c-4712-9287-2c28db2f7800 (92d95105-d98c-4712-9287-2c28db2f7800): created successfully
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274c71c8-887c-46db-9c41-ce33b29e19ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Flow 'volume_create_manager' (d3119295-c04b-46ef-bb7a-9e61596a175f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-77fff2e5-9b6f-40dd-ab2a-0d08a8060ac9 tempest-GroupsTest-972885595 None] Created volume successfully.
Sep 29 12:31:50 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a 1073741824" returned: 0 in 0.522s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:31:50 devstack sudo[97348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a
Sep 29 12:31:50 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Flow 'volume_create_manager' (59e7cd20-5835-45c4-a762-dcb7aad9272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52de6744-a29c-4c79-a0ff-4e8fb7a60c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52de6744-a29c-4c79-a0ff-4e8fb7a60c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-985751594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd81da15-f79e-4e90-934b-de03ef5ac8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531cac0061914d6fa5b95e7e4a0843f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:51Z,use_quota=True,user_id='145d9228491a47ec8b986e05ff48e3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff41c0ff-f43b-45b4-9162-25a873ece836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff41c0ff-f43b-45b4-9162-25a873ece836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccdf74d-ffd7-4d7e-9e21-84258cafed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccdf74d-ffd7-4d7e-9e21-84258cafed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd81da15-f79e-4e90-934b-de03ef5ac8a2', 'volume_name': 'volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a103c2d-5def-4693-b133-c371549400c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a103c2d-5def-4693-b133-c371549400c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1687705-7278-4dc3-bf63-bb5fbb85756f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:50 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Volume fd81da15-f79e-4e90-934b-de03ef5ac8a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2', 'volume_size': 1}
Sep 29 12:31:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:51 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.162s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-985751594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd81da15-f79e-4e90-934b-de03ef5ac8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531cac0061914d6fa5b95e7e4a0843f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:51Z,use_quota=True,user_id='145d9228491a47ec8b986e05ff48e3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Creating volume fd81da15-f79e-4e90-934b-de03ef5ac8a2 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:31:51 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d7c436-cc6c-41c4-b5ff-d960bd578af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a1377a-2fa8-4368-b857-b075cf9e9fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:51 devstack sudo[97351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 1073741824
Sep 29 12:31:51 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:51 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Volume volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a (2b0147b0-a0a8-4a67-bf1b-7bea53ab559a): created successfully
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a1377a-2fa8-4368-b857-b075cf9e9fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Flow 'volume_create_manager' (08687779-5eb8-4d52-b7c8-cc092424bfbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-abca1e45-d88c-46ee-934e-caa51f2df2e4 tempest-VolumesTransfersV355Test-662775821 None] Created volume successfully.
Sep 29 12:31:51 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 1073741824" returned: 0 in 0.582s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:51 devstack sudo[97357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2
Sep 29 12:31:51 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:52 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1687705-7278-4dc3-bf63-bb5fbb85756f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f37ce59-5790-4a53-a53f-34d27a915237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:52 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Volume volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 (fd81da15-f79e-4e90-934b-de03ef5ac8a2): created successfully
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f37ce59-5790-4a53-a53f-34d27a915237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Flow 'volume_create_manager' (59e7cd20-5835-45c4-a762-dcb7aad9272a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Flow 'volume_create_manager' (1aea5916-a9b4-4aea-93e9-9060d45119bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f261b04-5fc0-4ea7-8ba3-5e056df36f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-46e5580f-5160-4b2b-85c0-72543881a3ff tempest-VolumesDeleteCascade-259987171 None] Created volume successfully.
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f261b04-5fc0-4ea7-8ba3-5e056df36f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1591962798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a44c37ad-2da7-49f6-b986-bfcb79e526c0,host='devstack@QuobyteHD#QuobyteHD',id=4272bd2d-2105-4259-ae30-6eb15b7d185b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3cbbc5f35f47909b86a1aaa299aab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:52Z,use_quota=True,user_id='b8aa3813a20f482c91514298f67e5d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1342317c-68ec-4cb5-9551-dfb7642ec85a),volume_type_id=1342317c-68ec-4cb5-9551-dfb7642ec85a)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99027d90-a9e6-4735-8b88-54435238a318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99027d90-a9e6-4735-8b88-54435238a318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671375b9-c9fc-4439-bc21-f6dcf6118c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671375b9-c9fc-4439-bc21-f6dcf6118c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4272bd2d-2105-4259-ae30-6eb15b7d185b', 'volume_name': 'volume-4272bd2d-2105-4259-ae30-6eb15b7d185b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3aeb8a7-2e21-4286-95be-86e2e2b30ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3aeb8a7-2e21-4286-95be-86e2e2b30ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c39bee-af20-456a-9b86-f257fa24a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:52 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Volume 4272bd2d-2105-4259-ae30-6eb15b7d185b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4272bd2d-2105-4259-ae30-6eb15b7d185b', 'volume_size': 1}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a44c37ad-2da7-49f6-b986-bfcb79e526c0,created_at=2026-09-29T10:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1591962798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a44c37ad-2da7-49f6-b986-bfcb79e526c0,host='devstack@QuobyteHD#QuobyteHD',id=4272bd2d-2105-4259-ae30-6eb15b7d185b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3cbbc5f35f47909b86a1aaa299aab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:52Z,use_quota=True,user_id='b8aa3813a20f482c91514298f67e5d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1342317c-68ec-4cb5-9551-dfb7642ec85a),volume_type_id=1342317c-68ec-4cb5-9551-dfb7642ec85a)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Creating volume 4272bd2d-2105-4259-ae30-6eb15b7d185b {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:31:52 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:31:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4272bd2d-2105-4259-ae30-6eb15b7d185b 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:52 devstack sudo[97361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4272bd2d-2105-4259-ae30-6eb15b7d185b 1073741824
Sep 29 12:31:52 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:53 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4272bd2d-2105-4259-ae30-6eb15b7d185b 1073741824" returned: 0 in 0.703s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4272bd2d-2105-4259-ae30-6eb15b7d185b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:53 devstack sudo[97367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4272bd2d-2105-4259-ae30-6eb15b7d185b
Sep 29 12:31:53 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ff662dfe-75e5-437d-8aa2-5d5660595794 tempest-VolumesTransfersV355Test-323052025 None] Transfer volume completed successfully.
Sep 29 12:31:53 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4272bd2d-2105-4259-ae30-6eb15b7d185b" returned: 0 in 0.320s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.182s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c39bee-af20-456a-9b86-f257fa24a46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4272bd2d-2105-4259-ae30-6eb15b7d185b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cff377-223c-4c62-81ac-f5cee68ed756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] Creating offline snapshot 1a7c2973-a58c-4363-b897-9a108f669194 of volume fd81da15-f79e-4e90-934b-de03ef5ac8a2 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:31:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Volume volume-4272bd2d-2105-4259-ae30-6eb15b7d185b (4272bd2d-2105-4259-ae30-6eb15b7d185b): created successfully
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cff377-223c-4c62-81ac-f5cee68ed756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Flow 'volume_create_manager' (1aea5916-a9b4-4aea-93e9-9060d45119bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a5b336-1f5d-47ee-9c5e-153e7afd0b01]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b66a5444-2821-4802-87a7-b61a9446a988 tempest-GroupsTest-972885595 None] Created volume successfully.
Sep 29 12:31:53 devstack sudo[97370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2
Sep 29 12:31:53 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:53 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2" returned: 0 in 0.458s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:54 devstack sudo[97376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 1G
Sep 29 12:31:54 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Acquiring lock "cinder-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Lock "cinder-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Acquiring lock "cinder-quobyte-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Lock "cinder-quobyte-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa0f1fa-3924-458d-b735-cf9d639b80b3]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:54 devstack sudo[97378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a
Sep 29 12:31:54 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:54 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 1G" returned: 0 in 0.461s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:54 devstack sudo[97383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194
Sep 29 12:31:54 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:54 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a" returned: 0 in 0.425s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:54 devstack sudo[97388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a
Sep 29 12:31:54 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:54 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194" returned: 0 in 0.344s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:54 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 is being set with open permissions: ugo+rw
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:54 devstack sudo[97393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194
Sep 29 12:31:54 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:54 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Lock "cinder-quobyte-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a" released by "delete_volume" :: held 0.785s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8585471a-1ced-4649-bc65-93820c85a017 tempest-GroupsTest-972885595 None] Update group completed successfully.
Sep 29 12:31:54 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Created reservations ['664a32da-d85a-4ddf-b8da-1fa7fa7bf85b', '6ffeb7c0-1160-44f0-9bdc-345d86b28676', 'e8b8bdbf-2457-4abd-a181-68f9ea2f54a6', '28b41b54-c68b-4278-b4c3-f5c73abb8e2e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:55 devstack sudo[97397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:31:55 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:55 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194" returned: 0 in 0.313s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:55 devstack sudo[97399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.info
Sep 29 12:31:55 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:55 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.313s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:31:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Deleted volume successfully.
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5ea3db2e-29e1-4767-9f2a-417df2a40eba tempest-VolumesTransfersV355Test-585108852 None] Lock "cinder-2b0147b0-a0a8-4a67-bf1b-7bea53ab559a-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:55 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.info" returned: 0 in 0.306s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:55 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.info is being set with open permissions: ugo+rw
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:55 devstack sudo[97403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.info
Sep 29 12:31:55 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:55 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.info" returned: 0 in 0.331s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Flow 'volume_create_manager' (70fd62f8-a357-49ac-8fba-b6f575b50caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731f6f0b-8054-4393-a69f-8ef336aac76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5d59ba4e-d5e7-4880-9034-2cd7a49770ca tempest-VolumesDeleteCascade-259987171 None] Create snapshot completed successfully
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731f6f0b-8054-4393-a69f-8ef336aac76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-531213828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213dc860-d7da-4497-bbe6-f868751c7900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e71a5c53ff34cb8a41c6e8311e577a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:56Z,use_quota=True,user_id='fc4248507d1c4682a935dbb49e7275b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390bceba-2721-4e1f-805e-fcf6fd3837ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390bceba-2721-4e1f-805e-fcf6fd3837ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71037e59-d50f-41fe-b237-6fb9d8a3713e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71037e59-d50f-41fe-b237-6fb9d8a3713e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '213dc860-d7da-4497-bbe6-f868751c7900', 'volume_name': 'volume-213dc860-d7da-4497-bbe6-f868751c7900', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:55 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e002196-713a-4101-9aff-54a6cfc10a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e002196-713a-4101-9aff-54a6cfc10a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35765dc-2d0d-4c6a-871e-44eb9a4002f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:56 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Volume 213dc860-d7da-4497-bbe6-f868751c7900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-213dc860-d7da-4497-bbe6-f868751c7900', 'volume_size': 1}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-531213828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213dc860-d7da-4497-bbe6-f868751c7900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e71a5c53ff34cb8a41c6e8311e577a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:31:56Z,use_quota=True,user_id='fc4248507d1c4682a935dbb49e7275b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Creating volume 213dc860-d7da-4497-bbe6-f868751c7900 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:31:56 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-213dc860-d7da-4497-bbe6-f868751c7900 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:56 devstack sudo[97412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-213dc860-d7da-4497-bbe6-f868751c7900 1073741824
Sep 29 12:31:56 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=119,cinder:INSERT=25,cinder:UPDATE=137,cinder:DELETE=8 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=126,cinder:SELECT=118,cinder:DELETE=12,cinder:INSERT=33 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:31:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-77290cf8-0316-4588-b744-60fc0123179a tempest-GroupsTest-972885595 None] Update group completed successfully.
Sep 29 12:31:56 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-213dc860-d7da-4497-bbe6-f868751c7900 1073741824" returned: 0 in 0.602s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-213dc860-d7da-4497-bbe6-f868751c7900 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:56 devstack sudo[97420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-213dc860-d7da-4497-bbe6-f868751c7900
Sep 29 12:31:56 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:56 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-213dc860-d7da-4497-bbe6-f868751c7900" returned: 0 in 0.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.331s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35765dc-2d0d-4c6a-871e-44eb9a4002f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-213dc860-d7da-4497-bbe6-f868751c7900', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb0ffcd-0e70-4821-bf86-159a72d31545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:31:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] Creating offline snapshot 446c4f51-e5df-4c48-a0e4-f388ea305be8 of volume fd81da15-f79e-4e90-934b-de03ef5ac8a2 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:31:57 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Volume volume-213dc860-d7da-4497-bbe6-f868751c7900 (213dc860-d7da-4497-bbe6-f868751c7900): created successfully
Sep 29 12:31:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb0ffcd-0e70-4821-bf86-159a72d31545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:31:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Flow 'volume_create_manager' (70fd62f8-a357-49ac-8fba-b6f575b50caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:31:57 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b700830-3cec-4030-a660-05ae3fb08043]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0c6ab27e-2485-424e-968f-f477a9368e87 tempest-VolumesTransfersV355Test-662775821 None] Created volume successfully.
Sep 29 12:31:57 devstack sudo[97423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194
Sep 29 12:31:57 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:57 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194" returned: 0 in 0.448s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:31:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:57 devstack sudo[97428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 1G
Sep 29 12:31:57 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Acquiring lock "cinder-quobyte-4272bd2d-2105-4259-ae30-6eb15b7d185b" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Lock "cinder-quobyte-4272bd2d-2105-4259-ae30-6eb15b7d185b" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0692006d-0694-4e3c-8361-f40a9367526d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4272bd2d-2105-4259-ae30-6eb15b7d185b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:58 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 1G" returned: 0 in 0.633s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:58 devstack sudo[97435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8
Sep 29 12:31:58 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:58 devstack sudo[97434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4272bd2d-2105-4259-ae30-6eb15b7d185b
Sep 29 12:31:58 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Acquiring lock "cinder-213dc860-d7da-4497-bbe6-f868751c7900-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Lock "cinder-213dc860-d7da-4497-bbe6-f868751c7900-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Acquiring lock "cinder-quobyte-213dc860-d7da-4497-bbe6-f868751c7900" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Lock "cinder-quobyte-213dc860-d7da-4497-bbe6-f868751c7900" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f30c30c-2d8d-4c5d-a6b9-bad2622f6ec8]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-213dc860-d7da-4497-bbe6-f868751c7900 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:58 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8" returned: 0 in 0.355s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:58 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 is being set with open permissions: ugo+rw
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:58 devstack sudo[97446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8
Sep 29 12:31:58 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:58 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4272bd2d-2105-4259-ae30-6eb15b7d185b" returned: 0 in 0.465s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:58 devstack sudo[97441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-213dc860-d7da-4497-bbe6-f868751c7900
Sep 29 12:31:58 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4272bd2d-2105-4259-ae30-6eb15b7d185b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:58 devstack sudo[97449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4272bd2d-2105-4259-ae30-6eb15b7d185b
Sep 29 12:31:58 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:58 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e45458d7-76d5-461d-8504-082d24e1b9e0 tempest-VolumesDeleteCascade-259987171 None] Create snapshot completed successfully
Sep 29 12:31:58 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:58 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4272bd2d-2105-4259-ae30-6eb15b7d185b" returned: 0 in 0.293s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-213dc860-d7da-4497-bbe6-f868751c7900" returned: 0 in 0.423s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-213dc860-d7da-4497-bbe6-f868751c7900 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Lock "cinder-quobyte-4272bd2d-2105-4259-ae30-6eb15b7d185b" released by "delete_volume" :: held 0.835s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Acquiring lock "cinder-quobyte-92d95105-d98c-4712-9287-2c28db2f7800" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:58 devstack sudo[97456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-213dc860-d7da-4497-bbe6-f868751c7900
Sep 29 12:31:58 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Lock "cinder-quobyte-92d95105-d98c-4712-9287-2c28db2f7800" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5992251c-09dd-4c9f-9415-906f2b39eb89]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:31:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92d95105-d98c-4712-9287-2c28db2f7800 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:59 devstack sudo[97458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92d95105-d98c-4712-9287-2c28db2f7800
Sep 29 12:31:59 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:59 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-213dc860-d7da-4497-bbe6-f868751c7900" returned: 0 in 0.284s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Lock "cinder-quobyte-213dc860-d7da-4497-bbe6-f868751c7900" released by "delete_volume" :: held 0.750s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Created reservations ['5a90336c-7854-4b2f-9167-d05fc7a7649f', '54ff295a-0fd2-4fed-a226-9ea17c5f7cde', '61e8fff6-c64e-4b2c-a9de-937a0f2450d5', 'be0b3056-afff-435f-beb9-5ca4538bcf2f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:59 devstack sudo[97464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:31:59 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:59 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92d95105-d98c-4712-9287-2c28db2f7800" returned: 0 in 0.444s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92d95105-d98c-4712-9287-2c28db2f7800 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:31:59 devstack sudo[97466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92d95105-d98c-4712-9287-2c28db2f7800
Sep 29 12:31:59 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:31:59 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:31:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Deleted volume successfully.
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f7bd2a91-24d6-447d-91e1-8c25836153fa tempest-VolumesTransfersV355Test-585108852 None] Lock "cinder-213dc860-d7da-4497-bbe6-f868751c7900-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:59 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92d95105-d98c-4712-9287-2c28db2f7800" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Lock "cinder-quobyte-92d95105-d98c-4712-9287-2c28db2f7800" released by "delete_volume" :: held 0.859s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-fd81da15-f79e-4e90-934b-de03ef5ac8a2-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Created reservations ['19248fe1-fa52-45f2-ae73-6391803b22fb'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-fd81da15-f79e-4e90-934b-de03ef5ac8a2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:31:59 devstack cinder-volume[86369]: WARNING cinder.quota [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1415905830 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1415905830, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:31:59 devstack cinder-volume[86369]: WARNING cinder.quota [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1415905830 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1415905830, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Performing cascade delete. {{(pid=86369) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Created reservations ['989104e9-8328-42de-8c07-baf07b7145fb', '70901b51-86a9-48a0-b6eb-d5730f7cb167', '2f0b1321-280b-43a3-8362-4ff4a0b91f0a', 'c9ddf39d-0c69-4559-bc9f-94f1c2f56b66'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:31:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-1a7c2973-a58c-4363-b897-9a108f669194-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-1a7c2973-a58c-4363-b897-9a108f669194-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-quobyte-fd81da15-f79e-4e90-934b-de03ef5ac8a2" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-fd81da15-f79e-4e90-934b-de03ef5ac8a2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-quobyte-1a7c2973-a58c-4363-b897-9a108f669194" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-1a7c2973-a58c-4363-b897-9a108f669194" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Deleting offline snapshot 1a7c2973-a58c-4363-b897-9a108f669194 of volume fd81da15-f79e-4e90-934b-de03ef5ac8a2 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] snapshot_file for this snap is: volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6199ca-b73b-48f9-b059-9729fe9934be]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Created reservations ['f648359a-4347-49e8-b819-d37e8c7f2303', 'aab68c8b-0af3-4112-a1ca-c86ef10b773c', '73caed52-6118-44bb-8ab4-6a577232793e', 'fece2b32-8dba-4b79-ac25-7792f797f8c4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:00 devstack sudo[97478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194
Sep 29 12:32:00 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:00 devstack sudo[97480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:32:00 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:00 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194" returned: 0 in 0.439s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:32:00 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4030ce84-e5da-406e-8f4b-19fe9e1913fc]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:00 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:32:00 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1c1408bd-7f82-4248-83da-179b8c03a8e6 tempest-GroupsTest-972885595 None] Delete group completed successfully.
Sep 29 12:32:00 devstack sudo[97488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2
Sep 29 12:32:00 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:01 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2" returned: 0 in 0.548s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:01 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ffe776-0f59-41e7-a1d3-fbe65c204cb5]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:01 devstack sudo[97527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8
Sep 29 12:32:01 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:01 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8" returned: 0 in 0.474s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:32:01 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6278b8-0ee7-4a21-90e8-a923e562cadc]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:01 devstack sudo[97543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194
Sep 29 12:32:01 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:02 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194" returned: 0 in 0.576s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:32:02 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0d795d-22db-48ea-9393-38b313e8a5be]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:02 devstack sudo[97564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2
Sep 29 12:32:02 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:02 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2" returned: 0 in 0.631s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:03 devstack sudo[97569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194
Sep 29 12:32:03 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:03 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194" returned: 0 in 0.682s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:03 devstack sudo[97576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194
Sep 29 12:32:03 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:04 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.1a7c2973-a58c-4363-b897-9a108f669194" returned: 0 in 0.468s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 -F qcow2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:04 devstack sudo[97580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 -F qcow2
Sep 29 12:32:04 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:04 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 -F qcow2" returned: 0 in 0.415s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-1a7c2973-a58c-4363-b897-9a108f669194" released by "_delete_snapshot" :: held 4.551s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-fd81da15-f79e-4e90-934b-de03ef5ac8a2" released by "delete_snapshot" :: held 4.597s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:04 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Created reservations ['8dce212a-ae07-41a4-926f-8e07505f03d4', '2c1b738e-4a6a-4fbd-a974-8f4f355c549c', '50c62ef3-d97f-42e0-8120-b03f680a44b5', '6c88ebb8-cbaa-4395-aa33-74ac255c4f60'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Delete snapshot completed successfully.
Sep 29 12:32:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-1a7c2973-a58c-4363-b897-9a108f669194-delete_snapshot" released by "delete_snapshot" :: held 4.884s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-446c4f51-e5df-4c48-a0e4-f388ea305be8-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-446c4f51-e5df-4c48-a0e4-f388ea305be8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-quobyte-fd81da15-f79e-4e90-934b-de03ef5ac8a2" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-fd81da15-f79e-4e90-934b-de03ef5ac8a2" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-quobyte-446c4f51-e5df-4c48-a0e4-f388ea305be8" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-446c4f51-e5df-4c48-a0e4-f388ea305be8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Deleting offline snapshot 446c4f51-e5df-4c48-a0e4-f388ea305be8 of volume fd81da15-f79e-4e90-934b-de03ef5ac8a2 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:32:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] snapshot_file for this snap is: volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:32:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[610ea606-393b-4eb6-a47d-a8f20ffe022a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:05 devstack sudo[97586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8
Sep 29 12:32:05 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:05 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8" returned: 0 in 0.652s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:32:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[401d63a1-05ac-4d27-8edf-844450422387]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:05 devstack sudo[97592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2
Sep 29 12:32:05 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:06 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2" returned: 0 in 0.517s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:06 devstack sudo[97597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8
Sep 29 12:32:06 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:06 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8" returned: 0 in 0.583s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:06 devstack sudo[97603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8
Sep 29 12:32:06 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:07 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2.446c4f51-e5df-4c48-a0e4-f388ea305be8" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-446c4f51-e5df-4c48-a0e4-f388ea305be8" released by "_delete_snapshot" :: held 2.251s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-fd81da15-f79e-4e90-934b-de03ef5ac8a2" released by "delete_snapshot" :: held 2.292s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Created reservations ['821fe29c-9cd3-4ea4-ae86-16b99cef3ab5', '5df65772-e274-4951-b604-714cc56b539a', 'c54df213-5776-4b9e-96f5-18b7a9377370', 'e6fd5f17-ec22-4c5e-a97c-2c2924e07e72'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Delete snapshot completed successfully.
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-446c4f51-e5df-4c48-a0e4-f388ea305be8-delete_snapshot" released by "delete_snapshot" :: held 2.530s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Snapshots deleted, issuing volume delete {{(pid=86369) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-quobyte-fd81da15-f79e-4e90-934b-de03ef5ac8a2" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-fd81da15-f79e-4e90-934b-de03ef5ac8a2" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e212b4-5771-4415-8d2f-672d79db9dc5]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:07 devstack sudo[97606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2
Sep 29 12:32:07 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:07 devstack sudo[97610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:32:07 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:08 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2" returned: 0 in 0.562s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:08 devstack sudo[97615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2
Sep 29 12:32:08 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:08 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.654s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:32:08 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fd81da15-f79e-4e90-934b-de03ef5ac8a2" returned: 0 in 0.485s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-fd81da15-f79e-4e90-934b-de03ef5ac8a2" released by "delete_volume" :: held 1.134s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Created reservations ['b4b52739-47e0-43fb-bfc5-7eb88d4eabe7', '83a32006-295c-4c73-890e-d5c877142b67', '178701b4-23e4-487e-a0cd-f497f03a2436', '1d79141e-c6a7-4b3c-a4ee-37ad36f8cecd'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:08 devstack sudo[97619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:32:08 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:09 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.312s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:09 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:32:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Deleted volume successfully.
Sep 29 12:32:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c07594d7-2347-45a6-b4ed-611d0d271111 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-fd81da15-f79e-4e90-934b-de03ef5ac8a2-delete_volume" released by "delete_volume" :: held 9.305s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b17ae9d0-a385-4c5b-a862-2747c4760f6e tempest-GroupsV314Test-414349129 None] Group tempest-GroupsV314Test-Group-89199693: creating
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Flow 'volume_create_manager' (37d9a116-7ddd-497f-b67f-ebf3fe0f82f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338a8630-ec6f-4ebe-9860-e05f16e32981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338a8630-ec6f-4ebe-9860-e05f16e32981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1841611508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6080330-52cb-4e13-b0ac-b7bc34a8b321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531cac0061914d6fa5b95e7e4a0843f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:10Z,use_quota=True,user_id='145d9228491a47ec8b986e05ff48e3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c170a8c7-9848-4470-b8eb-cd5287565faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c170a8c7-9848-4470-b8eb-cd5287565faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33271c87-57a5-4485-88db-b2e3bcf50b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33271c87-57a5-4485-88db-b2e3bcf50b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6080330-52cb-4e13-b0ac-b7bc34a8b321', 'volume_name': 'volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7daccc-98e7-4446-a6a9-1b080be996d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7daccc-98e7-4446-a6a9-1b080be996d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655837c2-aa23-4726-a9f9-82417e31f83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:10 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Volume b6080330-52cb-4e13-b0ac-b7bc34a8b321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321', 'volume_size': 1}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1841611508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6080330-52cb-4e13-b0ac-b7bc34a8b321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531cac0061914d6fa5b95e7e4a0843f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:10Z,use_quota=True,user_id='145d9228491a47ec8b986e05ff48e3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Creating volume b6080330-52cb-4e13-b0ac-b7bc34a8b321 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:32:10 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b17ae9d0-a385-4c5b-a862-2747c4760f6e tempest-GroupsV314Test-414349129 None] Group tempest-GroupsV314Test-Group-89199693: created successfully
Sep 29 12:32:10 devstack sudo[97623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 1073741824
Sep 29 12:32:10 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b17ae9d0-a385-4c5b-a862-2747c4760f6e tempest-GroupsV314Test-414349129 None] Create group completed successfully.
Sep 29 12:32:10 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 1073741824" returned: 0 in 0.493s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:10 devstack sudo[97628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321
Sep 29 12:32:10 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:11 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321" returned: 0 in 0.485s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655837c2-aa23-4726-a9f9-82417e31f83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9553304b-99dc-43e3-882a-9c3767bb1a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Volume volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 (b6080330-52cb-4e13-b0ac-b7bc34a8b321): created successfully
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9553304b-99dc-43e3-882a-9c3767bb1a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Flow 'volume_create_manager' (37d9a116-7ddd-497f-b67f-ebf3fe0f82f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5a3350da-be3e-4709-928b-898f0606affa tempest-VolumesDeleteCascade-259987171 None] Created volume successfully.
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Flow 'volume_create_manager' (a7aa92a7-6c86-4fe6-8685-a109fe4127fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e2c096-68d2-48c0-9e77-45c607f5a129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e2c096-68d2-48c0-9e77-45c607f5a129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1382837463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919eb8f0-6e4d-48a4-a8cd-412d9436c1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4e5809968f453ca83a744e59856d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:11Z,use_quota=True,user_id='76b47624de6e455e92ecc966333656e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4e0b04-5433-4a2c-b0d0-50df6866c43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4e0b04-5433-4a2c-b0d0-50df6866c43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01a1a2d-9cc9-480a-a655-db66f1f565f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e01a1a2d-9cc9-480a-a655-db66f1f565f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '919eb8f0-6e4d-48a4-a8cd-412d9436c1d9', 'volume_name': 'volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e89dcb51-71d1-4c24-967c-25adec6318e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e89dcb51-71d1-4c24-967c-25adec6318e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3667f1d6-a1a9-4d05-a23d-8e62de964b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Volume 919eb8f0-6e4d-48a4-a8cd-412d9436c1d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9', 'volume_size': 1}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1382837463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919eb8f0-6e4d-48a4-a8cd-412d9436c1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4e5809968f453ca83a744e59856d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:11Z,use_quota=True,user_id='76b47624de6e455e92ecc966333656e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Creating volume 919eb8f0-6e4d-48a4-a8cd-412d9436c1d9 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:32:11 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:32:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:11 devstack sudo[97631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9 1073741824
Sep 29 12:32:11 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Flow 'volume_create_manager' (412bf5df-ba37-494f-8661-2c17563aee07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b4dc3d-2b8a-487e-8c48-e536da63fa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b4dc3d-2b8a-487e-8c48-e536da63fa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1764770525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1bb267a9-70a5-42c4-a56f-591f0cea559f,host='devstack@QuobyteHD#QuobyteHD',id=97da1752-b3d9-4a54-887f-334bdb8ba878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9240afc7b5ea434886d88452150c2614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:12Z,use_quota=True,user_id='2f16299144cf4bafabba1e8c9bd980a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85847bff-d663-4136-9d1c-b2eba3554409),volume_type_id=85847bff-d663-4136-9d1c-b2eba3554409)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b5690f-53b6-46bb-ac6a-337795e612b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b5690f-53b6-46bb-ac6a-337795e612b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f25f6a4-4d81-4d24-8a30-842965b2f94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f25f6a4-4d81-4d24-8a30-842965b2f94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97da1752-b3d9-4a54-887f-334bdb8ba878', 'volume_name': 'volume-97da1752-b3d9-4a54-887f-334bdb8ba878', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3498b3-e794-4587-ab56-35a5134205ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3498b3-e794-4587-ab56-35a5134205ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893a3d71-65d4-4e3f-9153-ed6f6f47ff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Volume 97da1752-b3d9-4a54-887f-334bdb8ba878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97da1752-b3d9-4a54-887f-334bdb8ba878', 'volume_size': 1}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:12 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9 1073741824" returned: 0 in 0.569s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:12 devstack sudo[97637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9
Sep 29 12:32:12 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:12 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9" returned: 0 in 0.280s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1bb267a9-70a5-42c4-a56f-591f0cea559f,created_at=2026-09-29T10:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1764770525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1bb267a9-70a5-42c4-a56f-591f0cea559f,host='devstack@QuobyteHD#QuobyteHD',id=97da1752-b3d9-4a54-887f-334bdb8ba878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9240afc7b5ea434886d88452150c2614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:12Z,use_quota=True,user_id='2f16299144cf4bafabba1e8c9bd980a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85847bff-d663-4136-9d1c-b2eba3554409),volume_type_id=85847bff-d663-4136-9d1c-b2eba3554409)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Creating volume 97da1752-b3d9-4a54-887f-334bdb8ba878 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:32:12 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:12 devstack sudo[97640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 1073741824
Sep 29 12:32:12 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3667f1d6-a1a9-4d05-a23d-8e62de964b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f651d3f5-c13e-4a84-8ca0-9a46a4cad5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Volume volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9 (919eb8f0-6e4d-48a4-a8cd-412d9436c1d9): created successfully
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f651d3f5-c13e-4a84-8ca0-9a46a4cad5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Flow 'volume_create_manager' (a7aa92a7-6c86-4fe6-8685-a109fe4127fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6a46de0d-973c-4f6e-a92f-7e500959a744 tempest-VolumesTransfersV357Test-1814386979 None] Created volume successfully.
Sep 29 12:32:12 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 1073741824" returned: 0 in 0.424s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:13 devstack sudo[97645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878
Sep 29 12:32:13 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:13 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.810s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893a3d71-65d4-4e3f-9153-ed6f6f47ff3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97da1752-b3d9-4a54-887f-334bdb8ba878', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951d02a8-d9f3-46f2-b5b2-88c3c325d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] Creating offline snapshot da703c7b-9d8e-46c1-9bca-0c5d181e8aee of volume b6080330-52cb-4e13-b0ac-b7bc34a8b321 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:32:13 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Volume volume-97da1752-b3d9-4a54-887f-334bdb8ba878 (97da1752-b3d9-4a54-887f-334bdb8ba878): created successfully
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951d02a8-d9f3-46f2-b5b2-88c3c325d019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Flow 'volume_create_manager' (412bf5df-ba37-494f-8661-2c17563aee07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[79089a5b-9ef3-4d5d-8a51-9bf50f74a26a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2d4829f8-0949-4ea8-9d60-e2037f2c9f6e tempest-GroupsV314Test-414349129 None] Created volume successfully.
Sep 29 12:32:13 devstack sudo[97648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321
Sep 29 12:32:13 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:13 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321" returned: 0 in 0.529s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:13 devstack sudo[97658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee 1G
Sep 29 12:32:13 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-25de8e05-7d0f-486d-8d1c-2a40fec3aa37 tempest-VolumesTransfersV357Test-280819145 None] Transfer volume completed successfully.
Sep 29 12:32:14 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee 1G" returned: 0 in 0.798s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:14 devstack sudo[97668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee
Sep 29 12:32:14 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:15 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee" returned: 0 in 0.574s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:15 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee is being set with open permissions: ugo+rw
Sep 29 12:32:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:15 devstack sudo[97673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee
Sep 29 12:32:15 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Acquiring lock "cinder-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Lock "cinder-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Acquiring lock "cinder-quobyte-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Lock "cinder-quobyte-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:15 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2726aa-2e36-47c7-94a4-64aabc0426cc]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:15 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee" returned: 0 in 0.440s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:15 devstack sudo[97677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.info
Sep 29 12:32:15 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:15 devstack sudo[97676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9
Sep 29 12:32:15 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:16 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.info" returned: 0 in 0.308s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:16 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.info is being set with open permissions: ugo+rw
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:16 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.info
Sep 29 12:32:16 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:16 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9" returned: 0 in 0.506s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:16 devstack sudo[97700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9
Sep 29 12:32:16 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:16 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.info" returned: 0 in 0.306s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.113s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.966s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:16 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Cloning volume 97da1752-b3d9-4a54-887f-334bdb8ba878 to volume 61b0241f-b9d2-49ac-80d7-8aad882e27cf
Sep 29 12:32:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-eea1b459-e119-4cc7-9d5f-5fdf197e6a12 tempest-VolumesDeleteCascade-259987171 None] Create snapshot completed successfully
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Creating offline snapshot e96374f6-b787-4f62-a4b2-b7831454cf62 of volume 97da1752-b3d9-4a54-887f-334bdb8ba878 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:32:16 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9" returned: 0 in 0.285s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[da881481-cc07-486b-9bbc-86854ce5e983]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Lock "cinder-quobyte-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9" released by "delete_volume" :: held 0.855s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Created reservations ['162d5e0f-9237-45c5-bdde-362701443d2e', '0524d16a-8204-42ff-907e-4c942672df03', '7655fbad-848d-43f0-8060-f6cf47d80edf', 'd45bb205-56fe-42b4-aa41-a25938d369e6'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:16 devstack sudo[97704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878
Sep 29 12:32:16 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:16 devstack sudo[97706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:32:16 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:17 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878" returned: 0 in 0.496s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:17 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.356s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:32:17 devstack sudo[97713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62 1G
Sep 29 12:32:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Deleted volume successfully.
Sep 29 12:32:17 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7c43a49b-57f2-4c09-92a2-16e207bb33e8 tempest-VolumesTransfersV357Test-1473926596 None] Lock "cinder-919eb8f0-6e4d-48a4-a8cd-412d9436c1d9-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Flow 'volume_create_manager' (07e1a7fc-c686-4836-9ba5-90849f32f46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b60d17d-021a-4be0-b9e0-0d4f3d8d431a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b60d17d-021a-4be0-b9e0-0d4f3d8d431a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1954635725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de22084-162e-4183-8497-afe456d53cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4e5809968f453ca83a744e59856d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:17Z,use_quota=True,user_id='76b47624de6e455e92ecc966333656e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3009f0c-ffad-4aa3-b155-18695b15e7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3009f0c-ffad-4aa3-b155-18695b15e7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94abba5-dce2-4898-b338-01fbf1416bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94abba5-dce2-4898-b338-01fbf1416bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8de22084-162e-4183-8497-afe456d53cec', 'volume_name': 'volume-8de22084-162e-4183-8497-afe456d53cec', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe02e26-4339-4bae-ac53-29f9cc01d77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe02e26-4339-4bae-ac53-29f9cc01d77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a837fb2-10b3-4ca1-835f-8130eb2bbcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Volume 8de22084-162e-4183-8497-afe456d53cec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8de22084-162e-4183-8497-afe456d53cec', 'volume_size': 1}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:17 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62 1G" returned: 0 in 0.535s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97da1752-b3d9-4a54-887f-334bdb8ba878 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:17 devstack sudo[97718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97da1752-b3d9-4a54-887f-334bdb8ba878 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62
Sep 29 12:32:17 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:32:17 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Flow 'volume_create_manager' (df8ade1a-a47f-4f9f-b027-524301142e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4a4496-bb17-48d7-b4b8-d3b48e47ac9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97da1752-b3d9-4a54-887f-334bdb8ba878 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62" returned: 0 in 0.359s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:17 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:17 devstack sudo[97724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62
Sep 29 12:32:17 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4a4496-bb17-48d7-b4b8-d3b48e47ac9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-861724504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14dc4546-72c1-473c-a50e-beabe8321ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531cac0061914d6fa5b95e7e4a0843f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da703c7b-9d8e-46c1-9bca-0c5d181e8aee,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:18Z,use_quota=True,user_id='145d9228491a47ec8b986e05ff48e3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c25bc5-78dd-4b6b-a760-0d4dfee5fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c25bc5-78dd-4b6b-a760-0d4dfee5fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31638c20-35aa-4bf4-a668-2e547cf0125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31638c20-35aa-4bf4-a668-2e547cf0125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '14dc4546-72c1-473c-a50e-beabe8321ce7', 'volume_name': 'volume-14dc4546-72c1-473c-a50e-beabe8321ce7', 'volume_size': 1, 'snapshot_id': 'da703c7b-9d8e-46c1-9bca-0c5d181e8aee'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7b4c1a-e1da-44f3-bafb-7e7b7f828e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7b4c1a-e1da-44f3-bafb-7e7b7f828e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506a5502-3c7c-4bde-8ee9-b33f7f38fd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Volume 14dc4546-72c1-473c-a50e-beabe8321ce7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-14dc4546-72c1-473c-a50e-beabe8321ce7', 'volume_size': 1, 'snapshot_id': 'da703c7b-9d8e-46c1-9bca-0c5d181e8aee'}
Sep 29 12:32:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:18 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62" returned: 0 in 0.255s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:18 devstack sudo[97727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.info
Sep 29 12:32:18 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:18 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.info" returned: 0 in 0.263s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:18 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:18 devstack sudo[97730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.info
Sep 29 12:32:18 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:18 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.info" returned: 0 in 0.254s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Acquiring lock "cinder-quobyte-61b0241f-b9d2-49ac-80d7-8aad882e27cf" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Lock "cinder-quobyte-61b0241f-b9d2-49ac-80d7-8aad882e27cf" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] snapshot: e96374f6-b787-4f62-a4b2-b7831454cf62, volume: 61b0241f-b9d2-49ac-80d7-8aad882e27cf,  {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[444c7d0e-b7e0-4b41-b651-59dd08ef8ecf]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:18 devstack sudo[97733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62
Sep 29 12:32:18 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:19 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97da1752-b3d9-4a54-887f-334bdb8ba878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:32:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[61514a6b-4d26-46c5-a686-093b7d9c7bcc]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:19 devstack sudo[97738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878
Sep 29 12:32:19 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:19 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878" returned: 0 in 0.360s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 12:32:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 12:32:19 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Path /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 12:32:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:19 devstack sudo[97743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf
Sep 29 12:32:19 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:26 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf" returned: 0 in 6.686s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:32:26 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Converted 1024.00 MB image at 153.13 MB/s
Sep 29 12:32:26 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:26 devstack sudo[97761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf
Sep 29 12:32:26 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:26 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf" returned: 0 in 0.255s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Lock "cinder-quobyte-61b0241f-b9d2-49ac-80d7-8aad882e27cf" released by "_copy_volume_from_snapshot" :: held 7.747s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Acquiring lock "cinder-quobyte-e96374f6-b787-4f62-a4b2-b7831454cf62" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Lock "cinder-quobyte-e96374f6-b787-4f62-a4b2-b7831454cf62" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Deleting offline snapshot e96374f6-b787-4f62-a4b2-b7831454cf62 of volume 97da1752-b3d9-4a54-887f-334bdb8ba878 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] snapshot_file for this snap is: volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01f9bbf-ffa3-4c1a-a9d4-91d7f144ed0f]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:26 devstack sudo[97766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62
Sep 29 12:32:26 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:26 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62" returned: 0 in 0.405s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97da1752-b3d9-4a54-887f-334bdb8ba878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:32:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1de81e-a157-465b-82bd-cd2f0514c92c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:27 devstack sudo[97771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878
Sep 29 12:32:27 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:27 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878" returned: 0 in 0.615s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:27 devstack sudo[97777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62
Sep 29 12:32:27 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:28 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62" returned: 0 in 0.465s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:28 devstack sudo[97784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62
Sep 29 12:32:28 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=70,cinder:SELECT=67,cinder:INSERT=20,cinder:DELETE=4 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:32:28 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878.e96374f6-b787-4f62-a4b2-b7831454cf62" returned: 0 in 0.285s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Lock "cinder-quobyte-e96374f6-b787-4f62-a4b2-b7831454cf62" released by "_delete_snapshot" :: held 1.883s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.897s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1954635725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de22084-162e-4183-8497-afe456d53cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4e5809968f453ca83a744e59856d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:17Z,use_quota=True,user_id='76b47624de6e455e92ecc966333656e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Creating volume 8de22084-162e-4183-8497-afe456d53cec {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:32:28 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:32:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-8de22084-162e-4183-8497-afe456d53cec 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:28 devstack sudo[97787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-8de22084-162e-4183-8497-afe456d53cec 1073741824
Sep 29 12:32:28 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c35d0d31-d3e3-41cf-9b93-5a46ab024b0f tempest-GroupsV314Test-414349129 None] Create group from source-group-1bb267a9-70a5-42c4-a56f-591f0cea559f completed successfully.
Sep 29 12:32:29 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-8de22084-162e-4183-8497-afe456d53cec 1073741824" returned: 0 in 0.602s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-8de22084-162e-4183-8497-afe456d53cec {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:29 devstack sudo[97795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-8de22084-162e-4183-8497-afe456d53cec
Sep 29 12:32:29 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:29 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-8de22084-162e-4183-8497-afe456d53cec" returned: 0 in 0.359s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 11.478s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-quobyte-da703c7b-9d8e-46c1-9bca-0c5d181e8aee-14dc4546-72c1-473c-a50e-beabe8321ce7" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a837fb2-10b3-4ca1-835f-8130eb2bbcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8de22084-162e-4183-8497-afe456d53cec', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1b0d14-1b49-4df2-9670-dfdd2fbe25e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-da703c7b-9d8e-46c1-9bca-0c5d181e8aee-14dc4546-72c1-473c-a50e-beabe8321ce7" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Creating volume 14dc4546-72c1-473c-a50e-beabe8321ce7 from snapshot da703c7b-9d8e-46c1-9bca-0c5d181e8aee {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-quobyte-14dc4546-72c1-473c-a50e-beabe8321ce7" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:29 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Volume volume-8de22084-162e-4183-8497-afe456d53cec (8de22084-162e-4183-8497-afe456d53cec): created successfully
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1b0d14-1b49-4df2-9670-dfdd2fbe25e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Flow 'volume_create_manager' (07e1a7fc-c686-4836-9ba5-90849f32f46e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-14dc4546-72c1-473c-a50e-beabe8321ce7" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] snapshot: da703c7b-9d8e-46c1-9bca-0c5d181e8aee, volume: 14dc4546-72c1-473c-a50e-beabe8321ce7,  {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 12:32:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ffed1289-5c6a-4aa2-b9b1-2a8b2a8823d9 tempest-VolumesTransfersV357Test-1814386979 None] Created volume successfully.
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-0f080b40-2075-489c-8024-21895f0dfba4 req-9105bb1a-d352-4810-9bb3-516d4b0df1dc tempest-TestMinimumBasicScenario-1819074765 None] Terminate volume connection completed successfully.
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0f080b40-2075-489c-8024-21895f0dfba4 req-9105bb1a-d352-4810-9bb3-516d4b0df1dc tempest-TestMinimumBasicScenario-1819074765 None] Deleting attachment 1dfa943e-6ced-4cf9-a612-1006b7cf8f8b. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[15092fd7-2e46-489b-97ad-36f7c468e42e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:29 devstack sudo[97805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee
Sep 29 12:32:29 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Acquiring lock "cinder-quobyte-61b0241f-b9d2-49ac-80d7-8aad882e27cf" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Lock "cinder-quobyte-61b0241f-b9d2-49ac-80d7-8aad882e27cf" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae76389-927e-4338-8f2b-a8cdb92e8e23]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:30 devstack sudo[97807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf
Sep 29 12:32:30 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:30 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee" returned: 0 in 0.480s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f648b1f-702f-48c7-98d5-99b2df7449ed]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:30 devstack sudo[97812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321
Sep 29 12:32:30 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Acquiring lock "cinder-84d31537-e024-4c53-ae0d-1f7a8029869f-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Lock "cinder-84d31537-e024-4c53-ae0d-1f7a8029869f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:30 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf" returned: 0 in 0.466s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:30 devstack sudo[97817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf
Sep 29 12:32:30 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:30 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321" returned: 0 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Path /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Acquiring lock "cinder-quobyte-84d31537-e024-4c53-ae0d-1f7a8029869f" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:30 devstack sudo[97823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7
Sep 29 12:32:30 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Lock "cinder-quobyte-84d31537-e024-4c53-ae0d-1f7a8029869f" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:30 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-61b0241f-b9d2-49ac-80d7-8aad882e27cf" returned: 0 in 0.306s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Lock "cinder-quobyte-61b0241f-b9d2-49ac-80d7-8aad882e27cf" released by "delete_volume" :: held 0.842s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4b19aa-3bee-4dc3-9275-cb66d18f8733]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-84d31537-e024-4c53-ae0d-1f7a8029869f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:30 devstack sudo[97825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-84d31537-e024-4c53-ae0d-1f7a8029869f
Sep 29 12:32:30 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:31 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-84d31537-e024-4c53-ae0d-1f7a8029869f" returned: 0 in 0.425s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-84d31537-e024-4c53-ae0d-1f7a8029869f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:31 devstack sudo[97840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-84d31537-e024-4c53-ae0d-1f7a8029869f
Sep 29 12:32:31 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:31 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-84d31537-e024-4c53-ae0d-1f7a8029869f" returned: 0 in 0.397s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Lock "cinder-quobyte-84d31537-e024-4c53-ae0d-1f7a8029869f" released by "delete_volume" :: held 0.889s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Created reservations ['4a16dc58-d35b-4765-a4de-aeeff38c010c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:31 devstack cinder-volume[86369]: WARNING cinder.quota [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1203161460 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1203161460, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:32:31 devstack cinder-volume[86369]: WARNING cinder.quota [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1203161460 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1203161460, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:32:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Created reservations ['3a61e198-5692-4e12-be57-b09c4c565d01', 'd0cacee8-5c47-49e6-81ad-79a593c0e2e9', '734e5ebd-1ab9-46c3-96a7-caf3dcb6da1e', '11ce2874-dd4b-4cf0-99f0-91768e6a184e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:33 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Created reservations ['80d47fa0-f6ce-4af4-9b28-a7c87015b06c', 'ae7c2d9a-eb75-4b18-98ec-b4c23dac6fe4', '0a939b96-0d73-4c47-9068-1b1c44504d63', '3451a3e2-b60b-4508-9235-ea8d30c0a70d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Acquiring lock "cinder-8de22084-162e-4183-8497-afe456d53cec-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Lock "cinder-8de22084-162e-4183-8497-afe456d53cec-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:34 devstack sudo[97848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:32:34 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:35 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.388s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:35 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:32:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Deleted volume successfully.
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3eb30daf-68ad-4d1a-8b51-9359b36aeb2c tempest-TestMinimumBasicScenario-1819074765 None] Lock "cinder-84d31537-e024-4c53-ae0d-1f7a8029869f-delete_volume" released by "delete_volume" :: held 6.047s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Acquiring lock "cinder-quobyte-8de22084-162e-4183-8497-afe456d53cec" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Lock "cinder-quobyte-8de22084-162e-4183-8497-afe456d53cec" acquired by "delete_volume" :: waited 0.074s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e8449d-625d-4aa1-a317-fb50bc12f76f]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-8de22084-162e-4183-8497-afe456d53cec {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:36 devstack sudo[97851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:32:36 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:36 devstack sudo[97853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-8de22084-162e-4183-8497-afe456d53cec
Sep 29 12:32:36 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:36 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.413s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:36 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:32:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-db715e2a-6c31-4812-960b-981fecb802c0 tempest-GroupsV314Test-414349129 None] Delete group completed successfully.
Sep 29 12:32:37 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-8de22084-162e-4183-8497-afe456d53cec" returned: 0 in 1.007s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-8de22084-162e-4183-8497-afe456d53cec {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:37 devstack sudo[97880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-8de22084-162e-4183-8497-afe456d53cec
Sep 29 12:32:37 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:37 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7" returned: 0 in 7.046s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:37 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:32:37 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Converted 1024.00 MB image at 145.30 MB/s
Sep 29 12:32:37 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7 is being set with open permissions: ugo+rw
Sep 29 12:32:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:37 devstack sudo[97886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7
Sep 29 12:32:37 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Acquiring lock "cinder-quobyte-97da1752-b3d9-4a54-887f-334bdb8ba878" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Lock "cinder-quobyte-97da1752-b3d9-4a54-887f-334bdb8ba878" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:37 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[075d0d81-6d75-4b76-bdc3-fccc84b0f052]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:37 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-8de22084-162e-4183-8497-afe456d53cec" returned: 0 in 0.394s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Lock "cinder-quobyte-8de22084-162e-4183-8497-afe456d53cec" released by "delete_volume" :: held 1.541s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Created reservations ['9eb9ee55-09d8-4fb5-8a95-9e49e6de63ed', '8f6b5cf5-a926-44ee-bd0a-ec28a834f0f7', '7231141c-18d7-41d8-b462-da4c4021d8f9', '67834f18-23ae-4208-97e3-6d92b85c7cb6'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:38 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7" returned: 0 in 0.456s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:38 devstack sudo[97890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878
Sep 29 12:32:38 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-14dc4546-72c1-473c-a50e-beabe8321ce7" released by "_copy_volume_from_snapshot" :: held 8.558s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-da703c7b-9d8e-46c1-9bca-0c5d181e8aee-14dc4546-72c1-473c-a50e-beabe8321ce7" released by "_create_volume_from_snapshot" :: held 8.693s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.738s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:38 devstack sudo[97893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:32:38 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506a5502-3c7c-4bde-8ee9-b33f7f38fd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14dc4546-72c1-473c-a50e-beabe8321ce7', 'volume_size': 1, 'snapshot_id': 'da703c7b-9d8e-46c1-9bca-0c5d181e8aee'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df35b17-9411-4e04-bcb6-725a2578f41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:38 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Volume volume-14dc4546-72c1-473c-a50e-beabe8321ce7 (14dc4546-72c1-473c-a50e-beabe8321ce7): created successfully
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df35b17-9411-4e04-bcb6-725a2578f41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Flow 'volume_create_manager' (df8ade1a-a47f-4f9f-b027-524301142e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3e57501e-7a26-473d-8509-4a3423b170fd tempest-VolumesDeleteCascade-259987171 None] Created volume successfully.
Sep 29 12:32:38 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878" returned: 0 in 0.599s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:38 devstack sudo[97899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878
Sep 29 12:32:38 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:38 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.402s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:32:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Deleted volume successfully.
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ce16eee4-ed26-4411-8930-141b8e0e2044 tempest-VolumesTransfersV357Test-1473926596 None] Lock "cinder-8de22084-162e-4183-8497-afe456d53cec-delete_volume" released by "delete_volume" :: held 4.905s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:38 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-97da1752-b3d9-4a54-887f-334bdb8ba878" returned: 0 in 0.410s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-b6080330-52cb-4e13-b0ac-b7bc34a8b321-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Lock "cinder-quobyte-97da1752-b3d9-4a54-887f-334bdb8ba878" released by "delete_volume" :: held 1.179s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-b6080330-52cb-4e13-b0ac-b7bc34a8b321-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Performing cascade delete. {{(pid=86369) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-da703c7b-9d8e-46c1-9bca-0c5d181e8aee-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-da703c7b-9d8e-46c1-9bca-0c5d181e8aee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Created reservations ['65bee196-106e-40c2-bcb0-cdfa11e1d1c3'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-quobyte-b6080330-52cb-4e13-b0ac-b7bc34a8b321" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-b6080330-52cb-4e13-b0ac-b7bc34a8b321" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-quobyte-da703c7b-9d8e-46c1-9bca-0c5d181e8aee" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-da703c7b-9d8e-46c1-9bca-0c5d181e8aee" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Deleting offline snapshot da703c7b-9d8e-46c1-9bca-0c5d181e8aee of volume b6080330-52cb-4e13-b0ac-b7bc34a8b321 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] snapshot_file for this snap is: volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa68c167-d83b-4461-95bd-d3d2ddde1f73]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Created reservations ['d6ac3874-087c-45f0-9a33-c6e985285bab', '0cdbfa16-a99d-450e-bb16-cb3442165686', 'f7b8ec77-45db-4f1c-87d4-0b6ed0a95c4b', 'bdea0f84-9baa-4496-9491-81c127597e73'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:39 devstack sudo[97904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee
Sep 29 12:32:39 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:39 devstack sudo[97906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:32:39 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:39 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee" returned: 0 in 0.495s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:32:39 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:32:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-50f24435-af5b-4f68-afc1-1ee067d319bf tempest-GroupsV314Test-414349129 None] Delete group completed successfully.
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9185ac44-3d93-48ff-b4c3-dde39dc58873]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:39 devstack sudo[97913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321
Sep 29 12:32:39 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:40 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321" returned: 0 in 0.666s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:40 devstack sudo[97918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee
Sep 29 12:32:40 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:40 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:40 devstack sudo[97924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee
Sep 29 12:32:40 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:41 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321.da703c7b-9d8e-46c1-9bca-0c5d181e8aee" returned: 0 in 0.337s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-da703c7b-9d8e-46c1-9bca-0c5d181e8aee" released by "_delete_snapshot" :: held 2.080s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-b6080330-52cb-4e13-b0ac-b7bc34a8b321" released by "delete_snapshot" :: held 2.122s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:41 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Created reservations ['f91a4c4c-4d19-4646-9e16-82fbecf2f2ec', 'c9afd359-d7a0-4332-bcab-01669ae68f95', 'd4edca79-7529-42b3-81a5-25ef1d91ce41', '19521d83-e352-4d4a-ad73-35ed0eabeffc'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Delete snapshot completed successfully.
Sep 29 12:32:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-da703c7b-9d8e-46c1-9bca-0c5d181e8aee-delete_snapshot" released by "delete_snapshot" :: held 2.438s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Snapshots deleted, issuing volume delete {{(pid=86369) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 29 12:32:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-quobyte-b6080330-52cb-4e13-b0ac-b7bc34a8b321" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-b6080330-52cb-4e13-b0ac-b7bc34a8b321" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e0f249-b27d-4b6a-bbd6-8e0cfc8cd7a0]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:41 devstack sudo[97928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321
Sep 29 12:32:41 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:42 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321" returned: 0 in 0.454s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:42 devstack sudo[97933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321
Sep 29 12:32:42 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:42 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b6080330-52cb-4e13-b0ac-b7bc34a8b321" returned: 0 in 0.346s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-b6080330-52cb-4e13-b0ac-b7bc34a8b321" released by "delete_volume" :: held 0.884s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Created reservations ['eefb6157-6cb2-4e69-915c-79fc7d47d335', '4f17780c-f8e8-4be3-be9e-bbc0573d2490', '363ecbc1-809a-4285-adaa-b62d0e3e84a5', '11c76f9b-9f17-4366-a900-e47c80d91e39'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:42 devstack sudo[97936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:32:42 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:42 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.290s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:32:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Deleted volume successfully.
Sep 29 12:32:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b5e37e38-8a37-4257-92ea-13f26f8ff38d tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-b6080330-52cb-4e13-b0ac-b7bc34a8b321-delete_volume" released by "delete_volume" :: held 3.956s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-14dc4546-72c1-473c-a50e-beabe8321ce7-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-14dc4546-72c1-473c-a50e-beabe8321ce7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "cinder-quobyte-14dc4546-72c1-473c-a50e-beabe8321ce7" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-14dc4546-72c1-473c-a50e-beabe8321ce7" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:43 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ceadf4b-a6c3-4aad-9875-2ab2db5e48ad]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:43 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7
Sep 29 12:32:43 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:44 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7" returned: 0 in 0.528s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:44 devstack sudo[97946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7
Sep 29 12:32:44 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:44 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14dc4546-72c1-473c-a50e-beabe8321ce7" returned: 0 in 0.368s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-quobyte-14dc4546-72c1-473c-a50e-beabe8321ce7" released by "delete_volume" :: held 0.966s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:44 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Created reservations ['fb2d676a-1d8c-4ec1-9da7-9e0fe8d46a7a', '436f456a-7ed0-40d1-b537-be212d6f33f4', '0c203e35-a4e6-4aba-9ec1-d431aacffe4a', 'f71c2e99-cada-46aa-80b2-e513059f788f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:32:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:44 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:32:44 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:45 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.276s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:45 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:32:45 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Deleted volume successfully.
Sep 29 12:32:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-03966ed9-2931-4708-b951-4d6a2d2068d3 tempest-VolumesDeleteCascade-259987171 None] Lock "cinder-14dc4546-72c1-473c-a50e-beabe8321ce7-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:32:49 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:32:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Flow 'volume_create_manager' (5f3adb2c-254b-4b66-8b14-e215e911f8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21698e9c-4331-4d03-a1cf-cf8866142381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21698e9c-4331-4d03-a1cf-cf8866142381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-573253602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065274c4-cd3d-4d67-ac48-388ba8d80a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cf25ddb8ba4ae797a11adbb63fefef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:50Z,use_quota=True,user_id='2c859ccbffc245c6b65fa3d8e623d091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f258cb36-9359-4122-9c27-c15a32606131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f258cb36-9359-4122-9c27-c15a32606131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d4b955-fc3b-46c6-b2a3-262eb003e108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d4b955-fc3b-46c6-b2a3-262eb003e108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065274c4-cd3d-4d67-ac48-388ba8d80a11', 'volume_name': 'volume-065274c4-cd3d-4d67-ac48-388ba8d80a11', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252a3f37-1391-4a88-9acf-b867ed9fff96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252a3f37-1391-4a88-9acf-b867ed9fff96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a79065a-435b-4b44-8488-4fa0bd76d77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:50 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Volume 065274c4-cd3d-4d67-ac48-388ba8d80a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065274c4-cd3d-4d67-ac48-388ba8d80a11', 'volume_size': 1}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-573253602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065274c4-cd3d-4d67-ac48-388ba8d80a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cf25ddb8ba4ae797a11adbb63fefef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:50Z,use_quota=True,user_id='2c859ccbffc245c6b65fa3d8e623d091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Creating volume 065274c4-cd3d-4d67-ac48-388ba8d80a11 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:32:50 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:50 devstack sudo[97968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 1073741824
Sep 29 12:32:50 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:50 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 1073741824" returned: 0 in 0.659s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:50 devstack sudo[97996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11
Sep 29 12:32:50 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:51 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11" returned: 0 in 0.338s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:51 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:32:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a79065a-435b-4b44-8488-4fa0bd76d77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065274c4-cd3d-4d67-ac48-388ba8d80a11', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57edced8-fef2-472f-a0f2-535b22d23ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:51 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Volume volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 (065274c4-cd3d-4d67-ac48-388ba8d80a11): created successfully
Sep 29 12:32:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57edced8-fef2-472f-a0f2-535b22d23ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Flow 'volume_create_manager' (5f3adb2c-254b-4b66-8b14-e215e911f8b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:51 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-938db43a-9ab1-419f-b310-f7ed488ca3ea tempest-VolumesCloneTest-800425476 None] Created volume successfully.
Sep 29 12:32:52 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:32:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Flow 'volume_create_manager' (dc31ff7f-da73-4d28-8e42-6617de15e409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ccca46-52ad-41ba-8905-1e358e577fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ccca46-52ad-41ba-8905-1e358e577fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1192281513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2b6478-d90d-440f-8a37-f1871b3cd7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c25f497259146ba984e71e9778b0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:52Z,use_quota=True,user_id='13ef3a57b6ff44988df48d576e6d25d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174add2c-e0e6-4c3f-992f-ae638c38493b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174add2c-e0e6-4c3f-992f-ae638c38493b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65e42ef-e3ea-4b2d-b22c-f7766b7912c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:52 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 12:32:52 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Flow 'volume_create_manager' (4eff900d-a454-46a0-863a-b1d41747e7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3934f8a5-e575-4af2-afbd-38f9fa94c61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3934f8a5-e575-4af2-afbd-38f9fa94c61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1231014156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bccf0ed-a104-4de0-9935-af4b99587deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cf25ddb8ba4ae797a11adbb63fefef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=065274c4-cd3d-4d67-ac48-388ba8d80a11,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:53Z,use_quota=True,user_id='2c859ccbffc245c6b65fa3d8e623d091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e690180e-1511-445b-a601-2988e59b03ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e690180e-1511-445b-a601-2988e59b03ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a45cca-37ef-4f2e-a1aa-0b2c1627582f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a45cca-37ef-4f2e-a1aa-0b2c1627582f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5bccf0ed-a104-4de0-9935-af4b99587deb', 'volume_name': 'volume-5bccf0ed-a104-4de0-9935-af4b99587deb', 'volume_size': 2, 'source_volid': '065274c4-cd3d-4d67-ac48-388ba8d80a11', 'source_volstatus': 'available'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff39fcbe-e2ff-44e6-b72a-7a9c455230aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff39fcbe-e2ff-44e6-b72a-7a9c455230aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deab5a08-a625-4426-8120-004bc385b659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Volume 5bccf0ed-a104-4de0-9935-af4b99587deb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5bccf0ed-a104-4de0-9935-af4b99587deb', 'volume_size': 2, 'source_volid': '065274c4-cd3d-4d67-ac48-388ba8d80a11', 'source_volstatus': 'available'}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65e42ef-e3ea-4b2d-b22c-f7766b7912c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a2b6478-d90d-440f-8a37-f1871b3cd7c7', 'volume_name': 'volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b7025560e90>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fea6279-a5b6-4266-9b6b-411101879c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fea6279-a5b6-4266-9b6b-411101879c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e378a011-427d-45b8-8949-996be3bb80a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:32:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Volume 6a2b6478-d90d-440f-8a37-f1871b3cd7c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b7025560e90>}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Trying to clone 6a2b6478-d90d-440f-8a37-f1871b3cd7c7 from image f8e17489-d113-49d7-ab01-94ac91f04646 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:53 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Cloning volume 065274c4-cd3d-4d67-ac48-388ba8d80a11 to volume 5bccf0ed-a104-4de0-9935-af4b99587deb
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Creating offline snapshot 12d28d81-dce8-4347-b236-72281652f127 of volume 065274c4-cd3d-4d67-ac48-388ba8d80a11 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6096700b-0d42-49c9-9fd4-74076641a6f2]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:53 devstack sudo[97999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11
Sep 29 12:32:53 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 12:32:53 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 12:32:53 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11" returned: 0 in 0.556s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:53 devstack sudo[98006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127 1G
Sep 29 12:32:53 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cec29e-953f-4750-b863-c183f3458a93]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:53 devstack sudo[98008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD
Sep 29 12:32:53 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:54 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:54 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Temporary image f8e17489-d113-49d7-ab01-94ac91f04646 is fetched for user 13ef3a57b6ff44988df48d576e6d25d5. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 12:32:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ff4749-4a46-42c4-8cb1-42b7fb21dc47]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:54 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127 1G" returned: 0 in 0.694s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:54 devstack sudo[98021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127
Sep 29 12:32:54 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:54 devstack sudo[98020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD
Sep 29 12:32:54 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:54 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127" returned: 0 in 0.350s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:54 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127 is being set with open permissions: ugo+rw
Sep 29 12:32:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:54 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:54 devstack sudo[98030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127
Sep 29 12:32:54 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:55 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127" returned: 0 in 0.344s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:55 devstack sudo[98033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.info
Sep 29 12:32:55 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:55 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.info" returned: 0 in 0.302s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:55 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.info is being set with open permissions: ugo+rw
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:55 devstack sudo[98036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.info
Sep 29 12:32:55 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:55 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.info" returned: 0 in 0.277s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Acquiring lock "cinder-quobyte-5bccf0ed-a104-4de0-9935-af4b99587deb" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Lock "cinder-quobyte-5bccf0ed-a104-4de0-9935-af4b99587deb" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] snapshot: 12d28d81-dce8-4347-b236-72281652f127, volume: 5bccf0ed-a104-4de0-9935-af4b99587deb,  {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[956fe459-aedc-41ec-bc33-2bb2014946a9]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:56 devstack sudo[98045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127
Sep 29 12:32:56 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:56 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127" returned: 0 in 0.428s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-065274c4-cd3d-4d67-ac48-388ba8d80a11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:32:56 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[335aefbd-650f-4487-a7ea-7b8f3e979b0c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:32:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:56 devstack sudo[98050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11
Sep 29 12:32:56 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:32:56 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root
Sep 29 12:32:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11" returned: 0 in 0.409s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:32:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 12:32:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 12:32:56 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Path /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 12:32:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:32:56 devstack sudo[98055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb
Sep 29 12:32:56 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=115,cinder:UPDATE=144,cinder:DELETE=9,cinder:INSERT=34 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Flow 'volume_create_manager' (7098b76f-9024-483f-9280-0575cddb701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0f0125-d663-4ac8-800d-95ba2656c710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0f0125-d663-4ac8-800d-95ba2656c710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-612328044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc03123-74f0-4987-9b80-36dc91a849da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a790e9f5d2f0485a95b43da61d05b5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:00Z,use_quota=True,user_id='93be97a44aff450babcb6767e9aff9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fb3623-fc8a-4233-ae4b-f9b398f5b7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fb3623-fc8a-4233-ae4b-f9b398f5b7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4be9a8-5fe3-4d97-8013-12e21087b93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4be9a8-5fe3-4d97-8013-12e21087b93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc03123-74f0-4987-9b80-36dc91a849da', 'volume_name': 'volume-7fc03123-74f0-4987-9b80-36dc91a849da', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fcd65ee-d6ca-4476-a3e4-91a4ac6f7842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fcd65ee-d6ca-4476-a3e4-91a4ac6f7842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3579333c-5e12-41ae-bf34-953c69dbc58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:00 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Volume 7fc03123-74f0-4987-9b80-36dc91a849da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc03123-74f0-4987-9b80-36dc91a849da', 'volume_size': 1}
Sep 29 12:33:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:04 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb" returned: 0 in 7.969s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:04 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11, size 1024.00 MB, duration 7.97 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:33:04 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Converted 1024.00 MB image at 128.48 MB/s
Sep 29 12:33:04 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb is being set with open permissions: ugo+rw
Sep 29 12:33:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:04 devstack sudo[98069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb
Sep 29 12:33:04 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:04 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Lock "cinder-quobyte-5bccf0ed-a104-4de0-9935-af4b99587deb" released by "_copy_volume_from_snapshot" :: held 9.159s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Acquiring lock "cinder-quobyte-12d28d81-dce8-4347-b236-72281652f127" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Lock "cinder-quobyte-12d28d81-dce8-4347-b236-72281652f127" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Deleting offline snapshot 12d28d81-dce8-4347-b236-72281652f127 of volume 065274c4-cd3d-4d67-ac48-388ba8d80a11 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:33:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] snapshot_file for this snap is: volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:33:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[10487275-c5fb-45e5-ab38-11c60c1eff25]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:05 devstack sudo[98072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127
Sep 29 12:33:05 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:05 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-065274c4-cd3d-4d67-ac48-388ba8d80a11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:33:05 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[081ad088-d794-4b24-a2b2-83ee920fc408]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:05 devstack sudo[98078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11
Sep 29 12:33:05 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:05 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11" returned: 0 in 0.517s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:06 devstack sudo[98083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127
Sep 29 12:33:06 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:06 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127" returned: 0 in 0.460s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:06 devstack sudo[98089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127
Sep 29 12:33:06 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:06 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11.12d28d81-dce8-4347-b236-72281652f127" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Lock "cinder-quobyte-12d28d81-dce8-4347-b236-72281652f127" released by "_delete_snapshot" :: held 1.737s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.665s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.978s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1192281513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2b6478-d90d-440f-8a37-f1871b3cd7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c25f497259146ba984e71e9778b0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:32:52Z,use_quota=True,user_id='13ef3a57b6ff44988df48d576e6d25d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Creating volume 6a2b6478-d90d-440f-8a37-f1871b3cd7c7 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:33:06 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:06 devstack sudo[98092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 1073741824
Sep 29 12:33:06 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deab5a08-a625-4426-8120-004bc385b659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bccf0ed-a104-4de0-9935-af4b99587deb', 'volume_size': 2, 'source_volid': '065274c4-cd3d-4d67-ac48-388ba8d80a11', 'source_volstatus': 'available'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c78e84-9d98-433c-964d-3ee8165ae184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Volume volume-5bccf0ed-a104-4de0-9935-af4b99587deb (5bccf0ed-a104-4de0-9935-af4b99587deb): created successfully
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c78e84-9d98-433c-964d-3ee8165ae184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Flow 'volume_create_manager' (4eff900d-a454-46a0-863a-b1d41747e7e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-df3dea4c-7fde-44af-af25-351e31b21ff0 tempest-VolumesCloneTest-800425476 None] Created volume successfully.
Sep 29 12:33:07 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 1073741824" returned: 0 in 0.656s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Acquiring lock "cinder-5bccf0ed-a104-4de0-9935-af4b99587deb-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Lock "cinder-5bccf0ed-a104-4de0-9935-af4b99587deb-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:07 devstack sudo[98098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7
Sep 29 12:33:07 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Acquiring lock "cinder-quobyte-5bccf0ed-a104-4de0-9935-af4b99587deb" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Lock "cinder-quobyte-5bccf0ed-a104-4de0-9935-af4b99587deb" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3381ea4a-6aea-4ac6-be48-13e1b0cabc3a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:07 devstack sudo[98102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb
Sep 29 12:33:07 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:07 devstack sudo[98104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:33:07 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:07 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7" returned: 0 in 0.397s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.562s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-612328044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc03123-74f0-4987-9b80-36dc91a849da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a790e9f5d2f0485a95b43da61d05b5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:00Z,use_quota=True,user_id='93be97a44aff450babcb6767e9aff9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Creating volume 7fc03123-74f0-4987-9b80-36dc91a849da {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:33:07 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:33:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fc03123-74f0-4987-9b80-36dc91a849da 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:08 devstack sudo[98107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fc03123-74f0-4987-9b80-36dc91a849da 1073741824
Sep 29 12:33:08 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Attempting download of f8e17489-d113-49d7-ab01-94ac91f04646 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}])) to volume 6a2b6478-d90d-440f-8a37-f1871b3cd7c7. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69abf06-e66d-4b97-8520-d9fe9486e666]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_hx2zq0g3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:08 devstack sudo[98111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_hx2zq0g3
Sep 29 12:33:08 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:08 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.467s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:33:08 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb" returned: 0 in 0.726s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:08 devstack sudo[98115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb
Sep 29 12:33:08 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:08 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_hx2zq0g3" returned: 0 in 0.427s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_hx2zq0g3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:08 devstack sudo[98122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_hx2zq0g3
Sep 29 12:33:08 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:08 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fc03123-74f0-4987-9b80-36dc91a849da 1073741824" returned: 0 in 0.891s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:08 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5bccf0ed-a104-4de0-9935-af4b99587deb" returned: 0 in 0.482s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Lock "cinder-quobyte-5bccf0ed-a104-4de0-9935-af4b99587deb" released by "delete_volume" :: held 1.294s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fc03123-74f0-4987-9b80-36dc91a849da {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:09 devstack sudo[98126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fc03123-74f0-4987-9b80-36dc91a849da
Sep 29 12:33:09 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Created reservations ['1e560d4f-520c-42b7-8aaa-1bc6702c0f34', '2d0bfb08-94e0-4df0-88fc-51c72ad88156', '8d7a633b-8ccc-4723-a0e7-d377b7e7333f', '4054ad61-d931-4d49-81e9-6e5cee548239'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:33:09 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_hx2zq0g3" returned: 1 in 0.565s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_hx2zq0g3' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[072a2bdf-fb89-40db-8441-c9669902f718]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:09 devstack sudo[98130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:33:09 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:09 devstack sudo[98131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD
Sep 29 12:33:09 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:09 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fc03123-74f0-4987-9b80-36dc91a849da" returned: 0 in 0.432s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3579333c-5e12-41ae-bf34-953c69dbc58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc03123-74f0-4987-9b80-36dc91a849da', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5ae221-ed01-40fc-9ac8-c0e00db75921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:09 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Volume volume-7fc03123-74f0-4987-9b80-36dc91a849da (7fc03123-74f0-4987-9b80-36dc91a849da): created successfully
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5ae221-ed01-40fc-9ac8-c0e00db75921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Flow 'volume_create_manager' (7098b76f-9024-483f-9280-0575cddb701e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-28acbbbf-2f22-4f0e-9c0b-3ad62f62967f tempest-VolumesServicesTestJSON-818186187 None] Created volume successfully.
Sep 29 12:33:09 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.363s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:33:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Deleted volume successfully.
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92b1aa10-8d62-4533-95e5-9e0a5b0b393a tempest-VolumesCloneTest-800425476 None] Lock "cinder-5bccf0ed-a104-4de0-9935-af4b99587deb-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:09 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] f8e17489-d113-49d7-ab01-94ac91f04646 was qcow2, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:09 devstack sudo[98139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7
Sep 29 12:33:09 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Acquiring lock "cinder-065274c4-cd3d-4d67-ac48-388ba8d80a11-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Lock "cinder-065274c4-cd3d-4d67-ac48-388ba8d80a11-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Acquiring lock "cinder-quobyte-065274c4-cd3d-4d67-ac48-388ba8d80a11" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Lock "cinder-quobyte-065274c4-cd3d-4d67-ac48-388ba8d80a11" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2624927c-642c-4d51-91f3-5e11ab6921d5]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:10 devstack sudo[98145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11
Sep 29 12:33:10 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Acquiring lock "cinder-7fc03123-74f0-4987-9b80-36dc91a849da-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Lock "cinder-7fc03123-74f0-4987-9b80-36dc91a849da-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Acquiring lock "cinder-quobyte-7fc03123-74f0-4987-9b80-36dc91a849da" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Lock "cinder-quobyte-7fc03123-74f0-4987-9b80-36dc91a849da" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28257df-6482-4ba8-95c0-a1e65d1840ff]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fc03123-74f0-4987-9b80-36dc91a849da {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:10 devstack sudo[98148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fc03123-74f0-4987-9b80-36dc91a849da
Sep 29 12:33:10 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:10 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11" returned: 0 in 0.536s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:10 devstack sudo[98153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11
Sep 29 12:33:10 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:10 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-065274c4-cd3d-4d67-ac48-388ba8d80a11" returned: 0 in 0.338s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:10 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fc03123-74f0-4987-9b80-36dc91a849da" returned: 0 in 0.568s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fc03123-74f0-4987-9b80-36dc91a849da {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Lock "cinder-quobyte-065274c4-cd3d-4d67-ac48-388ba8d80a11" released by "delete_volume" :: held 0.977s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:11 devstack sudo[98159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fc03123-74f0-4987-9b80-36dc91a849da
Sep 29 12:33:11 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Created reservations ['fbc2fe57-b9fa-4eb1-bdf4-bfb30d864c14', '8522ee7b-0e0c-4543-81d2-406dc0534c8a', 'f164999d-1135-41f4-af1d-25f5ac54a106', 'b406733a-f7b4-409b-80ec-5f9c0b9b0f3c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:11 devstack sudo[98161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:33:11 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:11 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fc03123-74f0-4987-9b80-36dc91a849da" returned: 0 in 0.355s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Lock "cinder-quobyte-7fc03123-74f0-4987-9b80-36dc91a849da" released by "delete_volume" :: held 0.989s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Created reservations ['e5b1f824-def9-490d-94ca-26836a7f64b4', '8fd82524-f333-4bf7-8599-75d4fc3a47b7', '6c7b54a6-da2b-4805-aebb-49200b3efe7c', 'c668d7ed-5fdb-4710-9bfe-7fff5137f9ba'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:11 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.382s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:33:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Deleted volume successfully.
Sep 29 12:33:11 devstack sudo[98165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:33:11 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b4908080-d1a7-455c-80d8-8bd6ecc53293 tempest-VolumesCloneTest-800425476 None] Lock "cinder-065274c4-cd3d-4d67-ac48-388ba8d80a11-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:11 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:33:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Deleted volume successfully.
Sep 29 12:33:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c91d8273-a01b-4659-b8d5-a89da0bef16a tempest-VolumesServicesTestJSON-818186187 None] Lock "cinder-7fc03123-74f0-4987-9b80-36dc91a849da-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:12 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7" returned: 0 in 2.521s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w_lt9oapdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:33:12 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Converted 112.00 MB image at 44.42 MB/s
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:12 devstack sudo[98168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 1G
Sep 29 12:33:12 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:12 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 1G" returned: 0 in 0.477s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Downloaded image f8e17489-d113-49d7-ab01-94ac91f04646 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}])) to volume 6a2b6478-d90d-440f-8a37-f1871b3cd7c7 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Temporary image f8e17489-d113-49d7-ab01-94ac91f04646 for user 13ef3a57b6ff44988df48d576e6d25d5 is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Marking volume 6a2b6478-d90d-440f-8a37-f1871b3cd7c7 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Copying metadata from image f8e17489-d113-49d7-ab01-94ac91f04646 to 6a2b6478-d90d-440f-8a37-f1871b3cd7c7. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Creating volume glance metadata for volume 6a2b6478-d90d-440f-8a37-f1871b3cd7c7 backed by image f8e17489-d113-49d7-ab01-94ac91f04646 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e378a011-427d-45b8-8949-996be3bb80a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b7025560e90>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f832066b-549d-4739-837b-a3986b2ac7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Volume volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 (6a2b6478-d90d-440f-8a37-f1871b3cd7c7): created successfully
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f832066b-549d-4739-837b-a3986b2ac7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Flow 'volume_create_manager' (dc31ff7f-da73-4d28-8e42-6617de15e409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-76b881ca-abd0-4776-8727-7611a446e206 tempest-VolumesExtendTest-1687319990 None] Created volume successfully.
Sep 29 12:33:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aca01d53-b472-411f-972a-372273f6296b tempest-VolumesExtendTest-1687319990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aca01d53-b472-411f-972a-372273f6296b tempest-VolumesExtendTest-1687319990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e66ec97-c01e-4a19-9c68-db49d24e2353]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aca01d53-b472-411f-972a-372273f6296b tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:14 devstack sudo[98175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7
Sep 29 12:33:14 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:14 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aca01d53-b472-411f-972a-372273f6296b tempest-VolumesExtendTest-1687319990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7" returned: 0 in 0.565s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aca01d53-b472-411f-972a-372273f6296b tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 2G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aca01d53-b472-411f-972a-372273f6296b tempest-VolumesExtendTest-1687319990 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 2G" returned: 0 in 0.123s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aca01d53-b472-411f-972a-372273f6296b tempest-VolumesExtendTest-1687319990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.720s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-aca01d53-b472-411f-972a-372273f6296b tempest-VolumesExtendTest-1687319990 None] Extend volume completed successfully.
Sep 29 12:33:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "cinder-6a2b6478-d90d-440f-8a37-f1871b3cd7c7-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-6a2b6478-d90d-440f-8a37-f1871b3cd7c7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "cinder-quobyte-6a2b6478-d90d-440f-8a37-f1871b3cd7c7" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-quobyte-6a2b6478-d90d-440f-8a37-f1871b3cd7c7" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b121b8b2-751f-40ae-9758-204eca1e0143]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:16 devstack sudo[98186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7
Sep 29 12:33:16 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:16 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7" returned: 0 in 0.503s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:16 devstack sudo[98191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7
Sep 29 12:33:16 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:17 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6a2b6478-d90d-440f-8a37-f1871b3cd7c7" returned: 0 in 0.336s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-quobyte-6a2b6478-d90d-440f-8a37-f1871b3cd7c7" released by "delete_volume" :: held 0.910s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:17 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Created reservations ['5db5142d-8f5d-4455-8fea-6252c9984a3a', '2c401b84-bd01-4433-8040-031b844bcbe6', 'cc377817-fd3c-45a2-8cbd-24ab887404cc', '3a973e24-bd9a-4bb0-8eb5-d46236cd45f4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:33:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:17 devstack sudo[98194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:33:17 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:17 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.331s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:17 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:33:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Deleted volume successfully.
Sep 29 12:33:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-05edf0cc-6e16-489f-826f-fda2edbdf152 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-6a2b6478-d90d-440f-8a37-f1871b3cd7c7-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Flow 'volume_create_manager' (26270dca-66a3-4b40-b3bb-484b93a810e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e359d30c-5a77-4c50-9dbc-b456c251cf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e359d30c-5a77-4c50-9dbc-b456c251cf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1512266959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ce7ffb-5681-4083-b813-fb994a2a19c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9951c0412dd643d7837fa2b98cc8ae36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:19Z,use_quota=True,user_id='d01a13d52bc84c418268cb1fc90e5775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f75e719-b1b1-43df-8528-a906cf1da4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f75e719-b1b1-43df-8528-a906cf1da4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e671f84-4cce-4119-8b64-4658f29cf3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e671f84-4cce-4119-8b64-4658f29cf3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ce7ffb-5681-4083-b813-fb994a2a19c8', 'volume_name': 'volume-09ce7ffb-5681-4083-b813-fb994a2a19c8', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febea5a8-3413-4d17-b4b3-252193ecb9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febea5a8-3413-4d17-b4b3-252193ecb9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2c77d7-f0c7-4ce3-9bea-8b44620a2e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Volume 09ce7ffb-5681-4083-b813-fb994a2a19c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ce7ffb-5681-4083-b813-fb994a2a19c8', 'volume_size': 1}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1512266959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ce7ffb-5681-4083-b813-fb994a2a19c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9951c0412dd643d7837fa2b98cc8ae36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:19Z,use_quota=True,user_id='d01a13d52bc84c418268cb1fc90e5775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Creating volume 09ce7ffb-5681-4083-b813-fb994a2a19c8 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:33:18 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:33:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-09ce7ffb-5681-4083-b813-fb994a2a19c8 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:18 devstack sudo[98197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-09ce7ffb-5681-4083-b813-fb994a2a19c8 1073741824
Sep 29 12:33:18 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Flow 'volume_create_manager' (674a7401-845f-44d0-be62-5f0537033dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde73521-ebda-4d90-91c3-b44749e5573e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde73521-ebda-4d90-91c3-b44749e5573e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2045856933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7575dc77-ac28-4917-91be-8874e5a58677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c25f497259146ba984e71e9778b0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:19Z,use_quota=True,user_id='13ef3a57b6ff44988df48d576e6d25d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c15e6b-c1ac-462a-9704-b0e2987dbfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c15e6b-c1ac-462a-9704-b0e2987dbfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb7a83a-ee35-4990-b96d-4edcecf64efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb7a83a-ee35-4990-b96d-4edcecf64efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7575dc77-ac28-4917-91be-8874e5a58677', 'volume_name': 'volume-7575dc77-ac28-4917-91be-8874e5a58677', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca941f6d-3461-426c-8941-be15afb702f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca941f6d-3461-426c-8941-be15afb702f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ff0f92-94d9-432a-9ea1-08416e8c1a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Volume 7575dc77-ac28-4917-91be-8874e5a58677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7575dc77-ac28-4917-91be-8874e5a58677', 'volume_size': 1}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:19 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-09ce7ffb-5681-4083-b813-fb994a2a19c8 1073741824" returned: 0 in 0.794s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-09ce7ffb-5681-4083-b813-fb994a2a19c8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:19 devstack sudo[98203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-09ce7ffb-5681-4083-b813-fb994a2a19c8
Sep 29 12:33:19 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:19 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-09ce7ffb-5681-4083-b813-fb994a2a19c8" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2045856933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7575dc77-ac28-4917-91be-8874e5a58677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c25f497259146ba984e71e9778b0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:19Z,use_quota=True,user_id='13ef3a57b6ff44988df48d576e6d25d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Creating volume 7575dc77-ac28-4917-91be-8874e5a58677 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:33:20 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:33:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2c77d7-f0c7-4ce3-9bea-8b44620a2e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ce7ffb-5681-4083-b813-fb994a2a19c8', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:20 devstack sudo[98206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677 1073741824
Sep 29 12:33:20 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf17d90-f05f-4650-9660-aa3ee4861f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Volume volume-09ce7ffb-5681-4083-b813-fb994a2a19c8 (09ce7ffb-5681-4083-b813-fb994a2a19c8): created successfully
Sep 29 12:33:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf17d90-f05f-4650-9660-aa3ee4861f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Flow 'volume_create_manager' (26270dca-66a3-4b40-b3bb-484b93a810e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ba8e6551-e9ea-4e37-884d-bead6ba4d9c6 tempest-VolumesListTestJSON-1620987336 None] Created volume successfully.
Sep 29 12:33:20 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677 1073741824" returned: 0 in 0.689s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:20 devstack sudo[98212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677
Sep 29 12:33:20 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:21 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677" returned: 0 in 0.353s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ff0f92-94d9-432a-9ea1-08416e8c1a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7575dc77-ac28-4917-91be-8874e5a58677', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3caa03-c1a7-4008-b9be-555b12edf98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Volume volume-7575dc77-ac28-4917-91be-8874e5a58677 (7575dc77-ac28-4917-91be-8874e5a58677): created successfully
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3caa03-c1a7-4008-b9be-555b12edf98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Flow 'volume_create_manager' (674a7401-845f-44d0-be62-5f0537033dd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-47e7eb29-03f7-406b-beba-b10df9e86cc1 tempest-VolumesExtendTest-1687319990 None] Created volume successfully.
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Flow 'volume_create_manager' (58f8ad0e-996e-4497-aa59-5bc5964b7737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfabacc0-2d81-4082-9ad6-9b8a0eabc504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfabacc0-2d81-4082-9ad6-9b8a0eabc504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1315787802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc15194a-643f-4335-b7ad-9d591be015dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9951c0412dd643d7837fa2b98cc8ae36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:21Z,use_quota=True,user_id='d01a13d52bc84c418268cb1fc90e5775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed41d774-b4f0-45c9-9c94-c95a0dffa4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed41d774-b4f0-45c9-9c94-c95a0dffa4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11729cb4-0e58-4095-a799-09dd88d85793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11729cb4-0e58-4095-a799-09dd88d85793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc15194a-643f-4335-b7ad-9d591be015dc', 'volume_name': 'volume-cc15194a-643f-4335-b7ad-9d591be015dc', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52071559-d12d-4a19-b6b4-fc18b8dfeba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52071559-d12d-4a19-b6b4-fc18b8dfeba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5489c2-e9c9-4d89-bf3c-68a80bbbd089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Volume cc15194a-643f-4335-b7ad-9d591be015dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc15194a-643f-4335-b7ad-9d591be015dc', 'volume_size': 1}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1315787802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc15194a-643f-4335-b7ad-9d591be015dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9951c0412dd643d7837fa2b98cc8ae36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:21Z,use_quota=True,user_id='d01a13d52bc84c418268cb1fc90e5775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Creating volume cc15194a-643f-4335-b7ad-9d591be015dc {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:33:21 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:33:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc15194a-643f-4335-b7ad-9d591be015dc 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:21 devstack sudo[98215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc15194a-643f-4335-b7ad-9d591be015dc 1073741824
Sep 29 12:33:21 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:22 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc15194a-643f-4335-b7ad-9d591be015dc 1073741824" returned: 0 in 0.571s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc15194a-643f-4335-b7ad-9d591be015dc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:22 devstack sudo[98221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc15194a-643f-4335-b7ad-9d591be015dc
Sep 29 12:33:22 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:22 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc15194a-643f-4335-b7ad-9d591be015dc" returned: 0 in 0.417s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5489c2-e9c9-4d89-bf3c-68a80bbbd089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc15194a-643f-4335-b7ad-9d591be015dc', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326b9fda-fa37-4ef8-b92c-ded8a86dcc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:22 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Volume volume-cc15194a-643f-4335-b7ad-9d591be015dc (cc15194a-643f-4335-b7ad-9d591be015dc): created successfully
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326b9fda-fa37-4ef8-b92c-ded8a86dcc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Flow 'volume_create_manager' (58f8ad0e-996e-4497-aa59-5bc5964b7737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6086b373-5e56-432d-a8ea-e8b1327ffed6 tempest-VolumesListTestJSON-1620987336 None] Created volume successfully.
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] Creating offline snapshot 7235be97-20e3-4590-9de8-3b9b2a3c222e of volume 7575dc77-ac28-4917-91be-8874e5a58677 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c71f26-2509-44f5-b460-325433e66363]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:22 devstack sudo[98224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677
Sep 29 12:33:22 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:23 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677" returned: 0 in 0.455s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:23 devstack sudo[98229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e 1G
Sep 29 12:33:23 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:23 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e 1G" returned: 0 in 0.628s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7575dc77-ac28-4917-91be-8874e5a58677 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:23 devstack sudo[98235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7575dc77-ac28-4917-91be-8874e5a58677 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e
Sep 29 12:33:23 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:24 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Flow 'volume_create_manager' (f7dfdb89-bc77-47e1-819d-25074f58e475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48b5613-cb0d-403d-8435-a91294c43490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7575dc77-ac28-4917-91be-8874e5a58677 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e" returned: 0 in 0.686s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:24 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e is being set with open permissions: ugo+rw
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48b5613-cb0d-403d-8435-a91294c43490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1784259642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9951c0412dd643d7837fa2b98cc8ae36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:24Z,use_quota=True,user_id='d01a13d52bc84c418268cb1fc90e5775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:24 devstack sudo[98241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e
Sep 29 12:33:24 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f14406-f584-4aa1-a351-505858bd5871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f14406-f584-4aa1-a351-505858bd5871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bc3f2c-9eb2-4124-8331-ed680ca611ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bc3f2c-9eb2-4124-8331-ed680ca611ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d', 'volume_name': 'volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45eb80e1-2309-4d74-96db-55206870ac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45eb80e1-2309-4d74-96db-55206870ac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd5d545-f340-49b7-994a-912ba6c86c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Volume eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d', 'volume_size': 1}
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:24 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e" returned: 0 in 0.363s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:25 devstack sudo[98244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.info
Sep 29 12:33:25 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:25 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.info" returned: 0 in 0.394s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:25 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.info is being set with open permissions: ugo+rw
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:25 devstack sudo[98247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.info
Sep 29 12:33:25 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:25 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.info" returned: 0 in 0.298s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1784259642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9951c0412dd643d7837fa2b98cc8ae36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:24Z,use_quota=True,user_id='d01a13d52bc84c418268cb1fc90e5775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Creating volume eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:33:25 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:33:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:25 devstack sudo[98250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d 1073741824
Sep 29 12:33:25 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e3792216-4c26-492b-aab1-11f8db50d5fa tempest-VolumesExtendTest-1687319990 None] Create snapshot completed successfully
Sep 29 12:33:26 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d 1073741824" returned: 0 in 0.572s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:26 devstack sudo[98256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d
Sep 29 12:33:26 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:26 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d" returned: 0 in 0.351s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:33:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd5d545-f340-49b7-994a-912ba6c86c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065ffbbc-3470-4bba-9b92-313893553a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Volume volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d (eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d): created successfully
Sep 29 12:33:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065ffbbc-3470-4bba-9b92-313893553a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Flow 'volume_create_manager' (f7dfdb89-bc77-47e1-819d-25074f58e475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-021abb08-a059-47a9-b540-4b35ec641e00 tempest-VolumesListTestJSON-1620987336 None] Created volume successfully.
Sep 29 12:33:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-48e26895-e85f-4615-ba89-bd469e1a7772 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-48e26895-e85f-4615-ba89-bd469e1a7772 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1d0f92-6d55-427e-b765-6aea00e7516a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48e26895-e85f-4615-ba89-bd469e1a7772 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:27 devstack sudo[98259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677
Sep 29 12:33:27 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:27 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48e26895-e85f-4615-ba89-bd469e1a7772 tempest-VolumesExtendTest-1687319990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677" returned: 0 in 0.478s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48e26895-e85f-4615-ba89-bd469e1a7772 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e 2G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-48e26895-e85f-4615-ba89-bd469e1a7772 tempest-VolumesExtendTest-1687319990 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e 2G" returned: 0 in 0.219s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-48e26895-e85f-4615-ba89-bd469e1a7772 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.757s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-48e26895-e85f-4615-ba89-bd469e1a7772 tempest-VolumesExtendTest-1687319990 None] Extend volume completed successfully.
Sep 29 12:33:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "cinder-7235be97-20e3-4590-9de8-3b9b2a3c222e-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-7235be97-20e3-4590-9de8-3b9b2a3c222e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "cinder-quobyte-7575dc77-ac28-4917-91be-8874e5a58677" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-quobyte-7575dc77-ac28-4917-91be-8874e5a58677" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "cinder-quobyte-7235be97-20e3-4590-9de8-3b9b2a3c222e" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-quobyte-7235be97-20e3-4590-9de8-3b9b2a3c222e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Deleting offline snapshot 7235be97-20e3-4590-9de8-3b9b2a3c222e of volume 7575dc77-ac28-4917-91be-8874e5a58677 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:33:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] snapshot_file for this snap is: volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:33:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[15daddc0-b913-469d-a75d-598024b35896]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:28 devstack sudo[98268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e
Sep 29 12:33:28 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:29 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e" returned: 0 in 0.536s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7575dc77-ac28-4917-91be-8874e5a58677(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:33:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c09dd8-41c8-4132-940d-cc1b7dd61dbc]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:29 devstack sudo[98273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677
Sep 29 12:33:29 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:29 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677" returned: 0 in 0.637s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:29 devstack sudo[98279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e
Sep 29 12:33:29 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:30 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e" returned: 0 in 0.654s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:30 devstack sudo[98285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e
Sep 29 12:33:30 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:30 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677.7235be97-20e3-4590-9de8-3b9b2a3c222e" returned: 0 in 0.422s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:30 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=130,cinder:SELECT=102,cinder:INSERT=38,cinder:DELETE=12 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:33:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-quobyte-7235be97-20e3-4590-9de8-3b9b2a3c222e" released by "_delete_snapshot" :: held 2.480s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-quobyte-7575dc77-ac28-4917-91be-8874e5a58677" released by "delete_snapshot" :: held 2.513s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:31 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Created reservations ['a4f3c588-ba52-4012-ba2c-167423088324', '1d957251-a81b-4702-a11d-e286948c4e6a', '57cbfec5-4b9b-40c7-a691-6e4f9b81d290', 'e9219e12-47e4-4317-9ee8-0784dc7eb372'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:33:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "cinder-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Lock "cinder-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Delete snapshot completed successfully.
Sep 29 12:33:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "cinder-quobyte-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ca91a0d1-2a4b-48de-a414-92455a7b1d47 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-7235be97-20e3-4590-9de8-3b9b2a3c222e-delete_snapshot" released by "delete_snapshot" :: held 2.869s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Lock "cinder-quobyte-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:31 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f66682-3422-4e04-8038-bf9ed4255112]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:31 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d
Sep 29 12:33:31 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "cinder-7575dc77-ac28-4917-91be-8874e5a58677-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-7575dc77-ac28-4917-91be-8874e5a58677-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:32 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d" returned: 0 in 0.740s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:32 devstack sudo[98294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d
Sep 29 12:33:32 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Flow 'volume_create_manager' (24062ac6-6695-4dc1-bffa-b8c30005d078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908c8bd0-6099-4d87-a83c-f840b235ff39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "cinder-quobyte-7575dc77-ac28-4917-91be-8874e5a58677" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908c8bd0-6099-4d87-a83c-f840b235ff39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1191809239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34a5bf5-43d2-4a60-8da9-8e8920862132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caba102aadf4494aa8af50d331376126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:32Z,use_quota=True,user_id='fc04761e105649cb9022a4987e13bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a833bcb8-85b8-4968-a105-dfe3534f235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a833bcb8-85b8-4968-a105-dfe3534f235c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ced0a6-a23c-46c4-9913-845fcf08f0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ced0a6-a23c-46c4-9913-845fcf08f0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34a5bf5-43d2-4a60-8da9-8e8920862132', 'volume_name': 'volume-f34a5bf5-43d2-4a60-8da9-8e8920862132', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2ceb1e-1cde-45f1-b046-4a90e5843613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2ceb1e-1cde-45f1-b046-4a90e5843613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365f626b-7e16-420d-9193-0f0e95d9425f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:32 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Volume f34a5bf5-43d2-4a60-8da9-8e8920862132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34a5bf5-43d2-4a60-8da9-8e8920862132', 'volume_size': 1}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1191809239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34a5bf5-43d2-4a60-8da9-8e8920862132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caba102aadf4494aa8af50d331376126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:32Z,use_quota=True,user_id='fc04761e105649cb9022a4987e13bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Creating volume f34a5bf5-43d2-4a60-8da9-8e8920862132 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:33:32 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f34a5bf5-43d2-4a60-8da9-8e8920862132 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-quobyte-7575dc77-ac28-4917-91be-8874e5a58677" acquired by "delete_volume" :: waited 0.168s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:32 devstack sudo[98296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f34a5bf5-43d2-4a60-8da9-8e8920862132 1073741824
Sep 29 12:33:32 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:32 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4756aa98-f483-4b0c-8a4c-312eba415dfa]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Lock "cinder-quobyte-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d" released by "delete_volume" :: held 1.198s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Created reservations ['9a4c98c0-fa58-41b5-8cf3-6f7a81378228', '60d569cb-72ad-4b1b-a349-c8891c50776b', 'b3fb05ae-b027-4102-ba8f-7ad28de02d87', '790c2afd-a0b4-42ea-8852-f0ff53f8fecc'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:33:32 devstack sudo[98299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677
Sep 29 12:33:32 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:32 devstack sudo[98304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:33:32 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:33:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Flow 'volume_create_manager' (b2e98294-4c68-4e9a-a582-6420d1fafec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d318411-c63b-479a-aef2-793262ee53ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:33 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:33 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677" returned: 0 in 0.682s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f34a5bf5-43d2-4a60-8da9-8e8920862132 1073741824" returned: 0 in 0.793s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d318411-c63b-479a-aef2-793262ee53ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1674075672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efce0c4e-07c4-4403-b9bc-84436969ab99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caba102aadf4494aa8af50d331376126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:33Z,use_quota=True,user_id='fc04761e105649cb9022a4987e13bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:33 devstack sudo[98310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677
Sep 29 12:33:33 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6457f10-5370-4b5e-9c48-4d654cfd5ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6457f10-5370-4b5e-9c48-4d654cfd5ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292566e3-c8f6-4f38-8944-a5e75440c7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292566e3-c8f6-4f38-8944-a5e75440c7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efce0c4e-07c4-4403-b9bc-84436969ab99', 'volume_name': 'volume-efce0c4e-07c4-4403-b9bc-84436969ab99', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe822469-d25a-4f21-90f5-3ad2a5a82761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe822469-d25a-4f21-90f5-3ad2a5a82761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adeafa22-ade5-416c-8b3f-57c4a7e05eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Volume efce0c4e-07c4-4403-b9bc-84436969ab99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efce0c4e-07c4-4403-b9bc-84436969ab99', 'volume_size': 1}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:33 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.509s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:33:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Deleted volume successfully.
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f34a5bf5-43d2-4a60-8da9-8e8920862132 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5086dcf4-097f-47cb-83f1-befe21519d54 tempest-VolumesListTestJSON-1620987336 None] Lock "cinder-eb9c2cd7-1de6-4cd7-80dc-cff58e1d0b9d-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:33 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f34a5bf5-43d2-4a60-8da9-8e8920862132
Sep 29 12:33:33 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:33 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7575dc77-ac28-4917-91be-8874e5a58677" returned: 0 in 0.456s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "cinder-cc15194a-643f-4335-b7ad-9d591be015dc-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-quobyte-7575dc77-ac28-4917-91be-8874e5a58677" released by "delete_volume" :: held 1.275s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Lock "cinder-cc15194a-643f-4335-b7ad-9d591be015dc-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:33 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f34a5bf5-43d2-4a60-8da9-8e8920862132" returned: 0 in 0.428s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.502s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1674075672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efce0c4e-07c4-4403-b9bc-84436969ab99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caba102aadf4494aa8af50d331376126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:33Z,use_quota=True,user_id='fc04761e105649cb9022a4987e13bb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Creating volume efce0c4e-07c4-4403-b9bc-84436969ab99 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:33:33 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-efce0c4e-07c4-4403-b9bc-84436969ab99 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "cinder-quobyte-cc15194a-643f-4335-b7ad-9d591be015dc" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365f626b-7e16-420d-9193-0f0e95d9425f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34a5bf5-43d2-4a60-8da9-8e8920862132', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f54c11-5ded-41fe-b509-3ce889b00973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:33 devstack sudo[98317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-efce0c4e-07c4-4403-b9bc-84436969ab99 1073741824
Sep 29 12:33:33 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Created reservations ['5d813505-e399-4162-9a40-b4cff3a11f73', '2383c1cd-4909-4add-92a8-979b48db288a', '78176a6b-dd5c-45c6-8361-634bce6c6746', 'a44aac22-efee-4148-be3d-726d8a2118ec'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Lock "cinder-quobyte-cc15194a-643f-4335-b7ad-9d591be015dc" acquired by "delete_volume" :: waited 0.040s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Volume volume-f34a5bf5-43d2-4a60-8da9-8e8920862132 (f34a5bf5-43d2-4a60-8da9-8e8920862132): created successfully
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f54c11-5ded-41fe-b509-3ce889b00973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Flow 'volume_create_manager' (24062ac6-6695-4dc1-bffa-b8c30005d078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0ab9e8-acac-4c1e-a24a-d96ef88110eb]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc15194a-643f-4335-b7ad-9d591be015dc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b3b64515-eabb-4f05-8b0a-09cc36852cd4 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Created volume successfully.
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:34 devstack sudo[98320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:33:34 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:34 devstack sudo[98319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc15194a-643f-4335-b7ad-9d591be015dc
Sep 29 12:33:34 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:34 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.474s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:34 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:33:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Deleted volume successfully.
Sep 29 12:33:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7b9c4d7-8857-49ce-ba69-d0f65b90f971 tempest-VolumesExtendTest-1687319990 None] Lock "cinder-7575dc77-ac28-4917-91be-8874e5a58677-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:34 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-efce0c4e-07c4-4403-b9bc-84436969ab99 1073741824" returned: 0 in 0.822s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-efce0c4e-07c4-4403-b9bc-84436969ab99 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:34 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc15194a-643f-4335-b7ad-9d591be015dc" returned: 0 in 0.763s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc15194a-643f-4335-b7ad-9d591be015dc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:34 devstack sudo[98333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-efce0c4e-07c4-4403-b9bc-84436969ab99
Sep 29 12:33:34 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:34 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc15194a-643f-4335-b7ad-9d591be015dc
Sep 29 12:33:34 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:35 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-efce0c4e-07c4-4403-b9bc-84436969ab99" returned: 0 in 0.446s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adeafa22-ade5-416c-8b3f-57c4a7e05eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efce0c4e-07c4-4403-b9bc-84436969ab99', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:35 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6c77dc-28b8-42dd-a964-8bce0b93795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc15194a-643f-4335-b7ad-9d591be015dc" returned: 0 in 0.474s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Lock "cinder-quobyte-cc15194a-643f-4335-b7ad-9d591be015dc" released by "delete_volume" :: held 1.327s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:35 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Volume volume-efce0c4e-07c4-4403-b9bc-84436969ab99 (efce0c4e-07c4-4403-b9bc-84436969ab99): created successfully
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6c77dc-28b8-42dd-a964-8bce0b93795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Flow 'volume_create_manager' (b2e98294-4c68-4e9a-a582-6420d1fafec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c09c3111-131b-4037-aec7-007846f82b5a tempest-TestServerVolumeAttachmentScenario-1044317951 None] Created volume successfully.
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Created reservations ['8e50f0d0-158d-43cb-b7d9-2f94e15647f4', '1deca526-e967-4fb4-95ef-ef874cea9801', '3474469d-a182-476a-8b9a-f0e5be6daeb3', 'ee448172-a9c1-4d65-a2d7-c8411f3734dc'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:35 devstack sudo[98340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:33:35 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:35 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:33:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Deleted volume successfully.
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6ab21448-6a5a-49a4-b1ee-3e2c61dc92ac tempest-VolumesListTestJSON-1620987336 None] Lock "cinder-cc15194a-643f-4335-b7ad-9d591be015dc-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "cinder-09ce7ffb-5681-4083-b813-fb994a2a19c8-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Lock "cinder-09ce7ffb-5681-4083-b813-fb994a2a19c8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "cinder-quobyte-09ce7ffb-5681-4083-b813-fb994a2a19c8" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Lock "cinder-quobyte-09ce7ffb-5681-4083-b813-fb994a2a19c8" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fe93a2-2983-444d-b383-25592e92ba6d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-09ce7ffb-5681-4083-b813-fb994a2a19c8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:36 devstack sudo[98343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-09ce7ffb-5681-4083-b813-fb994a2a19c8
Sep 29 12:33:36 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:36 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-09ce7ffb-5681-4083-b813-fb994a2a19c8" returned: 0 in 0.507s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-09ce7ffb-5681-4083-b813-fb994a2a19c8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:36 devstack sudo[98348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-09ce7ffb-5681-4083-b813-fb994a2a19c8
Sep 29 12:33:36 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:36 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-09ce7ffb-5681-4083-b813-fb994a2a19c8" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Lock "cinder-quobyte-09ce7ffb-5681-4083-b813-fb994a2a19c8" released by "delete_volume" :: held 0.857s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Created reservations ['aaa30a46-87d4-4386-a611-b3d37fc50b68', '33939c28-f78d-4225-999a-5895c1223800', '15e42c11-2dc9-4aae-b0f9-0cf0d58c4aca', 'b9a12656-12d5-403d-ad87-c86e6edd3285'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:33:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:37 devstack sudo[98351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:33:37 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:37 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.388s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:37 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:33:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Deleted volume successfully.
Sep 29 12:33:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1b45146b-42a0-453d-bb84-bf858621c2c1 tempest-VolumesListTestJSON-1620987336 None] Lock "cinder-09ce7ffb-5681-4083-b813-fb994a2a19c8-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Flow 'volume_create_manager' (5e2d5214-3e91-48fa-addc-9fb1baa703d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99514b06-7516-4e93-80cb-2d0b778118c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99514b06-7516-4e93-80cb-2d0b778118c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-208746005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83a0d59-482f-4ae8-96df-b631f36f802d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96d07914870404699c33610a662dcde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:41Z,use_quota=True,user_id='fe696d11ae8642a19cb263265bdeba76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab3109d-644a-41d2-9c4d-ffaaa3ae7ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab3109d-644a-41d2-9c4d-ffaaa3ae7ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13d5f56-6c5b-4540-9c4b-bb4c317d63bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13d5f56-6c5b-4540-9c4b-bb4c317d63bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83a0d59-482f-4ae8-96df-b631f36f802d', 'volume_name': 'volume-b83a0d59-482f-4ae8-96df-b631f36f802d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226a0c80-031a-4a5e-8ddf-3ed7c6f8f9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226a0c80-031a-4a5e-8ddf-3ed7c6f8f9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384e534a-164b-40ff-b46b-83c7d49614fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:40 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Volume b83a0d59-482f-4ae8-96df-b631f36f802d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83a0d59-482f-4ae8-96df-b631f36f802d', 'volume_size': 1}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-208746005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83a0d59-482f-4ae8-96df-b631f36f802d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96d07914870404699c33610a662dcde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:33:41Z,use_quota=True,user_id='fe696d11ae8642a19cb263265bdeba76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Creating volume b83a0d59-482f-4ae8-96df-b631f36f802d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:33:40 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:33:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:40 devstack sudo[98357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d 1073741824
Sep 29 12:33:40 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:41 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d 1073741824" returned: 0 in 0.771s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:41 devstack sudo[98376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d
Sep 29 12:33:41 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:42 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d" returned: 0 in 0.394s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:33:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384e534a-164b-40ff-b46b-83c7d49614fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83a0d59-482f-4ae8-96df-b631f36f802d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67eb9751-6f6b-473e-b87b-9b9617c4b81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:33:42 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Volume volume-b83a0d59-482f-4ae8-96df-b631f36f802d (b83a0d59-482f-4ae8-96df-b631f36f802d): created successfully
Sep 29 12:33:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67eb9751-6f6b-473e-b87b-9b9617c4b81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:33:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Flow 'volume_create_manager' (5e2d5214-3e91-48fa-addc-9fb1baa703d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:33:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9ce4b06b-8625-469d-b2c3-fb539587dfcb tempest-VolumesSnapshotListTestJSON-1654955369 None] Created volume successfully.
Sep 29 12:33:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] Creating offline snapshot fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 of volume b83a0d59-482f-4ae8-96df-b631f36f802d {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:33:43 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[29274105-745a-46a4-9c03-f49224da4e76]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:43 devstack sudo[98386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d
Sep 29 12:33:43 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:43 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d" returned: 0 in 0.437s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:43 devstack sudo[98392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 1G
Sep 29 12:33:43 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:44 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 1G" returned: 0 in 0.598s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83a0d59-482f-4ae8-96df-b631f36f802d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:44 devstack sudo[98400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83a0d59-482f-4ae8-96df-b631f36f802d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13
Sep 29 12:33:44 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:44 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83a0d59-482f-4ae8-96df-b631f36f802d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13" returned: 0 in 0.335s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:44 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 is being set with open permissions: ugo+rw
Sep 29 12:33:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:44 devstack sudo[98406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13
Sep 29 12:33:44 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:44 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13" returned: 0 in 0.336s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:44 devstack sudo[98409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.info
Sep 29 12:33:44 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:45 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.info" returned: 0 in 0.327s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:45 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.info is being set with open permissions: ugo+rw
Sep 29 12:33:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:45 devstack sudo[98412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.info
Sep 29 12:33:45 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:45 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.info" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:45 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0107295a-aa3b-48ff-8202-5f5dd6e89ad9 tempest-VolumesSnapshotListTestJSON-1654955369 None] Create snapshot completed successfully
Sep 29 12:33:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] Creating offline snapshot fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 of volume b83a0d59-482f-4ae8-96df-b631f36f802d {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:33:46 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df01334-dd8f-467c-90cc-7e52e20c7a82]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:46 devstack sudo[98416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13
Sep 29 12:33:46 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:47 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13" returned: 0 in 0.446s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83a0d59-482f-4ae8-96df-b631f36f802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:33:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:47 devstack sudo[98422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 1G
Sep 29 12:33:47 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:47 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 1G" returned: 0 in 0.551s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:47 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33
Sep 29 12:33:47 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:47 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33" returned: 0 in 0.363s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:48 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 is being set with open permissions: ugo+rw
Sep 29 12:33:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:48 devstack sudo[98433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33
Sep 29 12:33:48 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:48 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33" returned: 0 in 0.330s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bd0e6d73-74c9-48d3-83cb-eb79e346212f tempest-VolumesSnapshotListTestJSON-1654955369 None] Create snapshot completed successfully
Sep 29 12:33:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:33:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:33:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] Creating offline snapshot 9824ea63-ab71-4005-bea7-5863197433bb of volume b83a0d59-482f-4ae8-96df-b631f36f802d {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:33:49 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[70919800-ce0b-4a73-ba91-51ba37f6116b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:49 devstack sudo[98468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33
Sep 29 12:33:49 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:50 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33" returned: 0 in 0.822s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83a0d59-482f-4ae8-96df-b631f36f802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:33:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:50 devstack sudo[98499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb 1G
Sep 29 12:33:50 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:50 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb 1G" returned: 0 in 0.812s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:50 devstack sudo[98527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb
Sep 29 12:33:50 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:51 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb" returned: 0 in 0.620s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:51 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb is being set with open permissions: ugo+rw
Sep 29 12:33:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:51 devstack sudo[98566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb
Sep 29 12:33:51 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:52 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb" returned: 0 in 0.575s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.089s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:33:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cebea333-c25b-4892-b0f8-0b248b98a678 tempest-VolumesSnapshotListTestJSON-1654955369 None] Create snapshot completed successfully
Sep 29 12:33:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "cinder-9824ea63-ab71-4005-bea7-5863197433bb-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-9824ea63-ab71-4005-bea7-5863197433bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "cinder-quobyte-b83a0d59-482f-4ae8-96df-b631f36f802d" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-b83a0d59-482f-4ae8-96df-b631f36f802d" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "cinder-quobyte-9824ea63-ab71-4005-bea7-5863197433bb" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-9824ea63-ab71-4005-bea7-5863197433bb" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Deleting offline snapshot 9824ea63-ab71-4005-bea7-5863197433bb of volume b83a0d59-482f-4ae8-96df-b631f36f802d {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:33:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] snapshot_file for this snap is: volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:33:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35ecc3a-591a-4a2f-98af-0bf389efc3a6]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:55 devstack sudo[98588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb
Sep 29 12:33:55 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:56 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb" returned: 0 in 0.733s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83a0d59-482f-4ae8-96df-b631f36f802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:33:56 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5146d5a2-34d3-4fc5-a6e5-a39a32468db9]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:56 devstack sudo[98607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33
Sep 29 12:33:56 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:56 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33" returned: 0 in 0.507s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83a0d59-482f-4ae8-96df-b631f36f802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:33:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:56 devstack sudo[98612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb
Sep 29 12:33:56 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:57 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb" returned: 0 in 0.789s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:57 devstack sudo[98617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb
Sep 29 12:33:57 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:57 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.9824ea63-ab71-4005-bea7-5863197433bb" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-9824ea63-ab71-4005-bea7-5863197433bb" released by "_delete_snapshot" :: held 2.583s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-b83a0d59-482f-4ae8-96df-b631f36f802d" released by "delete_snapshot" :: held 2.629s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:58 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Created reservations ['bf51725d-2d54-4dab-9bda-6e388a786a92', 'd59abaa0-c656-4dbd-a798-6a077ba5b5c3', 'ae5cfffa-10ac-4ebd-ab7c-6fcc4369c7ad', '563910a7-e68e-46a8-80f5-8630584f39d8'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:33:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Delete snapshot completed successfully.
Sep 29 12:33:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-27c9b5ee-c717-495e-925e-52aa44ad4b6e tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-9824ea63-ab71-4005-bea7-5863197433bb-delete_snapshot" released by "delete_snapshot" :: held 2.913s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:33:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "cinder-fa021eb9-ba13-4c0a-94b0-e6f089a7fa33-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-fa021eb9-ba13-4c0a-94b0-e6f089a7fa33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "cinder-quobyte-b83a0d59-482f-4ae8-96df-b631f36f802d" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-b83a0d59-482f-4ae8-96df-b631f36f802d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "cinder-quobyte-fa021eb9-ba13-4c0a-94b0-e6f089a7fa33" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:33:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-fa021eb9-ba13-4c0a-94b0-e6f089a7fa33" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:33:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Deleting offline snapshot fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 of volume b83a0d59-482f-4ae8-96df-b631f36f802d {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:33:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] snapshot_file for this snap is: volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:33:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5034dd57-9586-49ae-b70e-cfa9019465a0]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:58 devstack sudo[98620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33
Sep 29 12:33:58 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:59 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33" returned: 0 in 0.578s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83a0d59-482f-4ae8-96df-b631f36f802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:33:59 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafd064e-3577-4fc4-971d-13050ca7683f]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:33:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:59 devstack sudo[98626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13
Sep 29 12:33:59 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:33:59 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root
Sep 29 12:33:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13" returned: 0 in 0.477s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:33:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83a0d59-482f-4ae8-96df-b631f36f802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:33:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:33:59 devstack sudo[98631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33
Sep 29 12:33:59 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:00 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33" returned: 0 in 0.625s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:00 devstack sudo[98637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33
Sep 29 12:34:00 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:01 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa021eb9-ba13-4c0a-94b0-e6f089a7fa33" returned: 0 in 0.577s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-fa021eb9-ba13-4c0a-94b0-e6f089a7fa33" released by "_delete_snapshot" :: held 2.476s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-b83a0d59-482f-4ae8-96df-b631f36f802d" released by "delete_snapshot" :: held 2.519s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:01 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=120,cinder:SELECT=80,cinder:INSERT=27,cinder:DELETE=11 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:34:01 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Created reservations ['f460d6f9-f10e-449a-ae31-a91c40275338', '6928e3e8-e52c-42e3-a8d0-5c3b2808b36d', 'c587e72e-9c4c-4e18-be3c-5086b5743a38', '98f095d7-5e63-4ff0-b25e-4bf29d21bc90'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Delete snapshot completed successfully.
Sep 29 12:34:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7871e63f-7ae4-4d5d-8c74-b79802944c05 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-fa021eb9-ba13-4c0a-94b0-e6f089a7fa33-delete_snapshot" released by "delete_snapshot" :: held 2.827s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "cinder-fa4b0a8a-e599-42b4-bb85-5a8c646d5a13-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-fa4b0a8a-e599-42b4-bb85-5a8c646d5a13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "cinder-quobyte-b83a0d59-482f-4ae8-96df-b631f36f802d" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-b83a0d59-482f-4ae8-96df-b631f36f802d" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "cinder-quobyte-fa4b0a8a-e599-42b4-bb85-5a8c646d5a13" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-fa4b0a8a-e599-42b4-bb85-5a8c646d5a13" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Deleting offline snapshot fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 of volume b83a0d59-482f-4ae8-96df-b631f36f802d {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:34:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] snapshot_file for this snap is: volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:34:02 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a15de0-e5fb-423b-be6c-ba37ecf43647]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:02 devstack sudo[98688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13
Sep 29 12:34:02 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:03 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13" returned: 0 in 1.056s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83a0d59-482f-4ae8-96df-b631f36f802d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:34:03 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7459b51d-7afa-4623-b215-ae9988d7820e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:03 devstack sudo[98712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d
Sep 29 12:34:03 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:04 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d" returned: 0 in 0.698s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:04 devstack sudo[98732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13
Sep 29 12:34:04 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:04 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13" returned: 0 in 0.900s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:04 devstack sudo[98768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13
Sep 29 12:34:04 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:05 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d.fa4b0a8a-e599-42b4-bb85-5a8c646d5a13" returned: 0 in 0.370s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-fa4b0a8a-e599-42b4-bb85-5a8c646d5a13" released by "_delete_snapshot" :: held 3.277s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-b83a0d59-482f-4ae8-96df-b631f36f802d" released by "delete_snapshot" :: held 3.337s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:05 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Created reservations ['4c3b1a47-9d2d-47d5-8fe3-87f5af2f834e', 'a4ec8a6d-47b4-4aba-9198-4832b75718cd', 'ea80d0e8-e757-42e8-8bf9-fd1d9022afe3', '0bbe76b7-8812-465c-abab-942e0f468b8a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Delete snapshot completed successfully.
Sep 29 12:34:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ded6976f-446e-4597-9eb9-537d6ef904da tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-fa4b0a8a-e599-42b4-bb85-5a8c646d5a13-delete_snapshot" released by "delete_snapshot" :: held 3.607s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "cinder-b83a0d59-482f-4ae8-96df-b631f36f802d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-b83a0d59-482f-4ae8-96df-b631f36f802d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "cinder-quobyte-b83a0d59-482f-4ae8-96df-b631f36f802d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-b83a0d59-482f-4ae8-96df-b631f36f802d" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[296e030e-bd04-4325-a187-e1220e3f1dc4]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:34:07 devstack sudo[98774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d
Sep 29 12:34:07 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Flow 'volume_create_manager' (206dfcef-18cb-4239-ac76-3afc1bca047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15660f10-3dae-4c96-be5e-72b95eedfcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15660f10-3dae-4c96-be5e-72b95eedfcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1809998466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66809da-d124-47a4-8e40-2920b5869e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3de693bc1a4dd7b031b8a8e2d6d25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:07Z,use_quota=True,user_id='37730e3fb580491cb24f5dc5211e2ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6020486c-49fb-436a-ac44-9349f354ff40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6020486c-49fb-436a-ac44-9349f354ff40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8390d605-110a-4fbf-89ef-bf3bc90be7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8390d605-110a-4fbf-89ef-bf3bc90be7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a66809da-d124-47a4-8e40-2920b5869e74', 'volume_name': 'volume-a66809da-d124-47a4-8e40-2920b5869e74', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d15b41f-f3e0-4a74-911b-1c45d8c72848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d15b41f-f3e0-4a74-911b-1c45d8c72848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb8c027-29a9-4bd6-9034-ba7aff4e81d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:07 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume a66809da-d124-47a4-8e40-2920b5869e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a66809da-d124-47a4-8e40-2920b5869e74', 'volume_size': 1}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1809998466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66809da-d124-47a4-8e40-2920b5869e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3de693bc1a4dd7b031b8a8e2d6d25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:07Z,use_quota=True,user_id='37730e3fb580491cb24f5dc5211e2ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Creating volume a66809da-d124-47a4-8e40-2920b5869e74 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:34:07 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:07 devstack sudo[98776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74 1073741824
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:34:07 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Flow 'volume_create_manager' (5567b5d7-d926-4deb-8ec7-a8159c7092bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039c96dc-4785-41ed-ba77-d32f69df073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039c96dc-4785-41ed-ba77-d32f69df073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1231197867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc4cbee-b6ee-4eab-81f9-d2796847b3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609767e3201b452fa9e95c05a7c28e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:07Z,use_quota=True,user_id='5214a599cae7432c9d339c5607fc4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8cfcc5b-76b4-44b3-9623-514f5e087ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8cfcc5b-76b4-44b3-9623-514f5e087ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e95affd-99b6-4386-a7fb-1136dcb9e253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e95affd-99b6-4386-a7fb-1136dcb9e253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc4cbee-b6ee-4eab-81f9-d2796847b3c9', 'volume_name': 'volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89f146d-1c74-46f5-9022-c3a30f99968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89f146d-1c74-46f5-9022-c3a30f99968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d802326-d1c8-48fa-9cf3-b5158950708e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:07 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Volume 4cc4cbee-b6ee-4eab-81f9-d2796847b3c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9', 'volume_size': 1}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:07 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d" returned: 0 in 0.466s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:07 devstack sudo[98781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d
Sep 29 12:34:07 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:07 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b83a0d59-482f-4ae8-96df-b631f36f802d" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-quobyte-b83a0d59-482f-4ae8-96df-b631f36f802d" released by "delete_volume" :: held 0.907s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:07 devstack sudo[98791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:34:07 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:07 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74 1073741824" returned: 0 in 0.672s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Created reservations ['3a7575ac-e074-48de-919d-22aca1f4d601', '411de4bc-f42f-4b67-8823-1a25b1a7f518', '257811a7-32cd-46cb-96c0-77884817516a', '8e3c0ffd-a365-4869-8f87-feec96aa5e16'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:08 devstack sudo[98793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74
Sep 29 12:34:08 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:08 devstack sudo[98795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:34:08 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:08 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.390s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:34:08 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.971s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1231197867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc4cbee-b6ee-4eab-81f9-d2796847b3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609767e3201b452fa9e95c05a7c28e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:07Z,use_quota=True,user_id='5214a599cae7432c9d339c5607fc4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Creating volume 4cc4cbee-b6ee-4eab-81f9-d2796847b3c9 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:08 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:34:08 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.315s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb8c027-29a9-4bd6-9034-ba7aff4e81d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a66809da-d124-47a4-8e40-2920b5869e74', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:08 devstack sudo[98800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9 1073741824
Sep 29 12:34:08 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c323eee4-4318-4fb7-9234-9c351ab535a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Deleted volume successfully.
Sep 29 12:34:08 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume volume-a66809da-d124-47a4-8e40-2920b5869e74 (a66809da-d124-47a4-8e40-2920b5869e74): created successfully
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c323eee4-4318-4fb7-9234-9c351ab535a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Flow 'volume_create_manager' (206dfcef-18cb-4239-ac76-3afc1bca047d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8194ae2e-6948-48af-b95e-99908b8e1e80 tempest-VolumesSnapshotListTestJSON-1654955369 None] Lock "cinder-b83a0d59-482f-4ae8-96df-b631f36f802d-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-37c6d3f4-10c7-4efe-b7f5-75e6198d1ba2 tempest-VolumesSnapshotTestJSON-1714803349 None] Created volume successfully.
Sep 29 12:34:08 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9 1073741824" returned: 0 in 0.476s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:08 devstack sudo[98805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9
Sep 29 12:34:08 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:09 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9" returned: 0 in 0.348s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] Creating offline snapshot e327434a-5ab6-4001-81cb-1952709e7d34 of volume a66809da-d124-47a4-8e40-2920b5869e74 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d802326-d1c8-48fa-9cf3-b5158950708e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e69c141-6adb-4c92-aad0-3ed321ae3865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c9073b-e8d1-493d-9a3d-d8987ada9995]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:09 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Volume volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9 (4cc4cbee-b6ee-4eab-81f9-d2796847b3c9): created successfully
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e69c141-6adb-4c92-aad0-3ed321ae3865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Flow 'volume_create_manager' (5567b5d7-d926-4deb-8ec7-a8159c7092bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-459ae67b-2c5e-49ae-9006-4fe78782886b tempest-VolumesActionsTest-2031353854 None] Created volume successfully.
Sep 29 12:34:09 devstack sudo[98808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74
Sep 29 12:34:09 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:09 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74" returned: 0 in 0.460s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:09 devstack sudo[98813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34 1G
Sep 29 12:34:09 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c80b3ae1-bafc-49c4-8adb-c7dcf2fdc3ae tempest-VolumesActionsTest-2031353854 None] Acquiring lock "cinder-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9" by "attach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c80b3ae1-bafc-49c4-8adb-c7dcf2fdc3ae tempest-VolumesActionsTest-2031353854 None] Lock "cinder-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9" acquired by "attach_volume" :: waited 0.048s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c80b3ae1-bafc-49c4-8adb-c7dcf2fdc3ae tempest-VolumesActionsTest-2031353854 None] Attaching volume 4cc4cbee-b6ee-4eab-81f9-d2796847b3c9 to instance 0f4c84bd-2a93-4c80-8a07-6b6ccafe7fcf at mountpoint /dev/vdb on host None.
Sep 29 12:34:10 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34 1G" returned: 0 in 0.697s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a66809da-d124-47a4-8e40-2920b5869e74 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c80b3ae1-bafc-49c4-8adb-c7dcf2fdc3ae tempest-VolumesActionsTest-2031353854 None] Attach volume completed successfully.
Sep 29 12:34:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c80b3ae1-bafc-49c4-8adb-c7dcf2fdc3ae tempest-VolumesActionsTest-2031353854 None] Lock "cinder-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9" released by "attach_volume" :: held 0.252s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:10 devstack sudo[98818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a66809da-d124-47a4-8e40-2920b5869e74 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34
Sep 29 12:34:10 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a66809da-d124-47a4-8e40-2920b5869e74 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34" returned: 0 in 0.565s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:11 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34 is being set with open permissions: ugo+rw
Sep 29 12:34:11 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:11 devstack sudo[98824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34
Sep 29 12:34:11 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:11 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34" returned: 0 in 0.422s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:11 devstack sudo[98827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.info
Sep 29 12:34:11 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9fb067d3-dd50-42b7-a1ac-0ef0795e3fe9 tempest-VolumesActionsTest-220787436 None] Terminate volume connection completed successfully.
Sep 29 12:34:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9fb067d3-dd50-42b7-a1ac-0ef0795e3fe9 tempest-VolumesActionsTest-220787436 None] Acquiring lock "cinder-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9-detach_volume" by "detach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9fb067d3-dd50-42b7-a1ac-0ef0795e3fe9 tempest-VolumesActionsTest-220787436 None] Lock "cinder-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9fb067d3-dd50-42b7-a1ac-0ef0795e3fe9 tempest-VolumesActionsTest-220787436 None] Detaching volume 4cc4cbee-b6ee-4eab-81f9-d2796847b3c9 from instance 0f4c84bd-2a93-4c80-8a07-6b6ccafe7fcf.
Sep 29 12:34:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9fb067d3-dd50-42b7-a1ac-0ef0795e3fe9 tempest-VolumesActionsTest-220787436 None] Detach volume completed successfully.
Sep 29 12:34:12 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-9fb067d3-dd50-42b7-a1ac-0ef0795e3fe9 tempest-VolumesActionsTest-220787436 None] Lock "cinder-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.info" returned: 0 in 0.578s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:12 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.info is being set with open permissions: ugo+rw
Sep 29 12:34:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:12 devstack sudo[98830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.info
Sep 29 12:34:12 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e849c645-5c27-41d5-8b8f-c75e9a60230a tempest-VolumesActionsTest-2031353854 None] Acquiring lock "cinder-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9-detach_volume" by "detach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e849c645-5c27-41d5-8b8f-c75e9a60230a tempest-VolumesActionsTest-2031353854 None] Lock "cinder-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e849c645-5c27-41d5-8b8f-c75e9a60230a tempest-VolumesActionsTest-2031353854 None] Volume detach called, but volume not attached.
Sep 29 12:34:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e849c645-5c27-41d5-8b8f-c75e9a60230a tempest-VolumesActionsTest-2031353854 None] Lock "cinder-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:12 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.info" returned: 0 in 0.507s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.414s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-992bd3e0-257a-4cc8-b412-81d233b2eb79 tempest-VolumesSnapshotTestJSON-1714803349 None] Create snapshot completed successfully
Sep 29 12:34:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Acquiring lock "cinder-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Lock "cinder-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Acquiring lock "cinder-quobyte-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Lock "cinder-quobyte-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[25936231-107f-4082-bb19-eb0ea28478ba]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:13 devstack sudo[98833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9
Sep 29 12:34:13 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:13 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9" returned: 0 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:13 devstack sudo[98838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9
Sep 29 12:34:13 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-e327434a-5ab6-4001-81cb-1952709e7d34-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-e327434a-5ab6-4001-81cb-1952709e7d34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:14 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-a66809da-d124-47a4-8e40-2920b5869e74" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9" returned: 0 in 0.598s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Lock "cinder-quobyte-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9" released by "delete_volume" :: held 1.092s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-a66809da-d124-47a4-8e40-2920b5869e74" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-e327434a-5ab6-4001-81cb-1952709e7d34" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-e327434a-5ab6-4001-81cb-1952709e7d34" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Deleting offline snapshot e327434a-5ab6-4001-81cb-1952709e7d34 of volume a66809da-d124-47a4-8e40-2920b5869e74 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] snapshot_file for this snap is: volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c50937d-2745-4544-a5a7-3feb9d448eef]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Created reservations ['72b4dc30-3e03-47a5-ac31-ea1ed5309327', '2d615a9b-8704-4b8c-9c6d-8f8385a00ed0', '59bd3943-0bdf-47ac-93b7-c3662b57975c', '2c5833cd-d437-4f0e-9bdf-d31f0f1deed3'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:14 devstack sudo[98842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34
Sep 29 12:34:14 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:14 devstack sudo[98843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:34:14 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:14 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.333s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:34:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Deleted volume successfully.
Sep 29 12:34:14 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34" returned: 0 in 0.533s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a66809da-d124-47a4-8e40-2920b5869e74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4b686362-7af5-4b95-880e-ea2568df39c3 tempest-VolumesActionsTest-2031353854 None] Lock "cinder-4cc4cbee-b6ee-4eab-81f9-d2796847b3c9-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6952d08d-82ed-4806-b339-057c6a3c663c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:14 devstack sudo[98851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74
Sep 29 12:34:14 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:15 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74" returned: 0 in 0.468s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:15 devstack sudo[98856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34
Sep 29 12:34:15 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:15 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34" returned: 0 in 0.698s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:15 devstack sudo[98868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34
Sep 29 12:34:15 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:16 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74.e327434a-5ab6-4001-81cb-1952709e7d34" returned: 0 in 0.391s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-e327434a-5ab6-4001-81cb-1952709e7d34" released by "_delete_snapshot" :: held 2.314s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-a66809da-d124-47a4-8e40-2920b5869e74" released by "delete_snapshot" :: held 2.358s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:16 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Created reservations ['7944dc72-c631-43a3-895f-c90e910400c3', '0710b966-7371-461a-84f8-a11f1def3e40', '98619013-a298-4d02-bc30-8a20fc70a794', 'e53d9e2d-ecd5-40ab-8295-bb3548bc1eb2'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Delete snapshot completed successfully.
Sep 29 12:34:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a7736cd3-63c3-4c94-ad5e-d7c2cca6e516 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-e327434a-5ab6-4001-81cb-1952709e7d34-delete_snapshot" released by "delete_snapshot" :: held 2.795s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Flow 'volume_create_manager' (b037b41a-644d-46cb-b834-ecfacdf21472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae71d1f-e64c-49a2-80b4-a21a75795ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae71d1f-e64c-49a2-80b4-a21a75795ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-927039288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8567b4-dd78-489d-ac1c-4081d07572bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3de693bc1a4dd7b031b8a8e2d6d25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:18Z,use_quota=True,user_id='37730e3fb580491cb24f5dc5211e2ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab3ce64-938b-4d18-a0fb-4f1ba6b0f407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab3ce64-938b-4d18-a0fb-4f1ba6b0f407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86377da7-708b-4673-9b21-cbd43f5468f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86377da7-708b-4673-9b21-cbd43f5468f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd8567b4-dd78-489d-ac1c-4081d07572bd', 'volume_name': 'volume-cd8567b4-dd78-489d-ac1c-4081d07572bd', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367980b0-31e7-4b6f-bc79-5c9b6d714930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367980b0-31e7-4b6f-bc79-5c9b6d714930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770d721d-e16f-4cec-ad8d-715c864cfbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume cd8567b4-dd78-489d-ac1c-4081d07572bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd8567b4-dd78-489d-ac1c-4081d07572bd', 'volume_size': 1}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-927039288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8567b4-dd78-489d-ac1c-4081d07572bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3de693bc1a4dd7b031b8a8e2d6d25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:18Z,use_quota=True,user_id='37730e3fb580491cb24f5dc5211e2ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Creating volume cd8567b4-dd78-489d-ac1c-4081d07572bd {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:34:18 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:18 devstack sudo[98910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd 1073741824
Sep 29 12:34:18 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-da69cb40-4c02-4eb3-85f9-51c6d7de8a3e req-8db30b8d-b146-4997-b544-784a71e31acd tempest-TestServerVolumeAttachmentScenario-1044317951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:18 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd 1073741824" returned: 0 in 0.713s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:19 devstack sudo[98919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd
Sep 29 12:34:19 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:19 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:34:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-da69cb40-4c02-4eb3-85f9-51c6d7de8a3e req-8db30b8d-b146-4997-b544-784a71e31acd tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.751s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-da69cb40-4c02-4eb3-85f9-51c6d7de8a3e req-8db30b8d-b146-4997-b544-784a71e31acd tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770d721d-e16f-4cec-ad8d-715c864cfbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8567b4-dd78-489d-ac1c-4081d07572bd', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0947af20-8281-434e-be6e-2413044078eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume volume-cd8567b4-dd78-489d-ac1c-4081d07572bd (cd8567b4-dd78-489d-ac1c-4081d07572bd): created successfully
Sep 29 12:34:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0947af20-8281-434e-be6e-2413044078eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Flow 'volume_create_manager' (b037b41a-644d-46cb-b834-ecfacdf21472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-26bea1b3-d262-42a0-b76f-1b89248b9885 tempest-VolumesSnapshotTestJSON-1714803349 None] Created volume successfully.
Sep 29 12:34:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-da69cb40-4c02-4eb3-85f9-51c6d7de8a3e req-8db30b8d-b146-4997-b544-784a71e31acd tempest-TestServerVolumeAttachmentScenario-1044317951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-f34a5bf5-43d2-4a60-8da9-8e8920862132', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbfcc41e-c7e5-4b9c-b5f9-dbb4814cd8c0', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:34:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-da69cb40-4c02-4eb3-85f9-51c6d7de8a3e req-8db30b8d-b146-4997-b544-784a71e31acd tempest-TestServerVolumeAttachmentScenario-1044317951 None] attachment_update completed successfully.
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Flow 'volume_create_manager' (7b211af4-f76a-42f2-905e-159d3c3e8fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f177e41a-981f-400c-b016-ae43611ed5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f177e41a-981f-400c-b016-ae43611ed5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1352580678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b124c1a6-41a7-49b3-b400-ff30541ee833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609767e3201b452fa9e95c05a7c28e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:20Z,use_quota=True,user_id='5214a599cae7432c9d339c5607fc4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3200d592-f2da-40fe-a19c-9bcf58b26cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3200d592-f2da-40fe-a19c-9bcf58b26cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ae695a-f83c-4df6-9382-7e97e99b5fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ae695a-f83c-4df6-9382-7e97e99b5fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b124c1a6-41a7-49b3-b400-ff30541ee833', 'volume_name': 'volume-b124c1a6-41a7-49b3-b400-ff30541ee833', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770094e4-0a0e-4277-88ea-bd30c39133be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770094e4-0a0e-4277-88ea-bd30c39133be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fe9011-7331-488b-84f0-eb92cb8e4f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Volume b124c1a6-41a7-49b3-b400-ff30541ee833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b124c1a6-41a7-49b3-b400-ff30541ee833', 'volume_size': 1}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1352580678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b124c1a6-41a7-49b3-b400-ff30541ee833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609767e3201b452fa9e95c05a7c28e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:20Z,use_quota=True,user_id='5214a599cae7432c9d339c5607fc4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Creating volume b124c1a6-41a7-49b3-b400-ff30541ee833 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:34:20 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b124c1a6-41a7-49b3-b400-ff30541ee833 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:20 devstack sudo[99340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b124c1a6-41a7-49b3-b400-ff30541ee833 1073741824
Sep 29 12:34:20 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:20 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b124c1a6-41a7-49b3-b400-ff30541ee833 1073741824" returned: 0 in 0.597s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b124c1a6-41a7-49b3-b400-ff30541ee833 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:21 devstack sudo[99346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b124c1a6-41a7-49b3-b400-ff30541ee833
Sep 29 12:34:21 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:21 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b124c1a6-41a7-49b3-b400-ff30541ee833" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.916s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fe9011-7331-488b-84f0-eb92cb8e4f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b124c1a6-41a7-49b3-b400-ff30541ee833', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f28a02a-4f75-4ca9-92ad-5d56bb52a0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] Creating offline snapshot 1259e88c-0522-497d-b07a-8812312a41fd of volume cd8567b4-dd78-489d-ac1c-4081d07572bd {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:34:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Volume volume-b124c1a6-41a7-49b3-b400-ff30541ee833 (b124c1a6-41a7-49b3-b400-ff30541ee833): created successfully
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f28a02a-4f75-4ca9-92ad-5d56bb52a0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Flow 'volume_create_manager' (7b211af4-f76a-42f2-905e-159d3c3e8fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4775417-42c8-4178-8f1b-bf2b1112c96f]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8b3a9d65-e04f-4785-85fe-8970d941285d tempest-VolumesActionsTest-2031353854 None] Created volume successfully.
Sep 29 12:34:21 devstack sudo[99349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd
Sep 29 12:34:21 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:21 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd" returned: 0 in 0.446s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:21 devstack sudo[99354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd 1G
Sep 29 12:34:21 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:22 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Acquiring lock "cinder-b124c1a6-41a7-49b3-b400-ff30541ee833-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd 1G" returned: 0 in 0.801s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd8567b4-dd78-489d-ac1c-4081d07572bd -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Lock "cinder-b124c1a6-41a7-49b3-b400-ff30541ee833-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:22 devstack sudo[99360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd8567b4-dd78-489d-ac1c-4081d07572bd -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd
Sep 29 12:34:22 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Acquiring lock "cinder-quobyte-b124c1a6-41a7-49b3-b400-ff30541ee833" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Lock "cinder-quobyte-b124c1a6-41a7-49b3-b400-ff30541ee833" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:22 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafbac3d-b71c-4377-9521-9dccd405f5b0]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b124c1a6-41a7-49b3-b400-ff30541ee833 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:22 devstack sudo[99362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b124c1a6-41a7-49b3-b400-ff30541ee833
Sep 29 12:34:22 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:23 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd8567b4-dd78-489d-ac1c-4081d07572bd -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd" returned: 0 in 0.483s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:23 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd is being set with open permissions: ugo+rw
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:23 devstack sudo[99367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd
Sep 29 12:34:23 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:23 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b124c1a6-41a7-49b3-b400-ff30541ee833" returned: 0 in 0.491s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b124c1a6-41a7-49b3-b400-ff30541ee833 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:23 devstack sudo[99373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b124c1a6-41a7-49b3-b400-ff30541ee833
Sep 29 12:34:23 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:23 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd" returned: 0 in 0.449s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:23 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b124c1a6-41a7-49b3-b400-ff30541ee833" returned: 0 in 0.298s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Lock "cinder-quobyte-b124c1a6-41a7-49b3-b400-ff30541ee833" released by "delete_volume" :: held 0.848s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:23 devstack sudo[99377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.info
Sep 29 12:34:23 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Created reservations ['b10d9fc8-7712-4dfb-8801-a5cbba4dc395', '9bff7711-ec1d-4434-b06c-e57062de2081', '21609c6f-6a00-49fd-8a78-ca8e1a36e9f3', '20203ffb-c893-4408-9c09-8420bfb5e4ee'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:23 devstack sudo[99379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:34:23 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:24 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.info" returned: 0 in 0.416s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:24 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.info is being set with open permissions: ugo+rw
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:24 devstack sudo[99382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.info
Sep 29 12:34:24 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:24 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.468s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:34:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Deleted volume successfully.
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e7e52281-89c2-4076-be46-878710a63bc2 tempest-VolumesActionsTest-220787436 None] Lock "cinder-b124c1a6-41a7-49b3-b400-ff30541ee833-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:24 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.info" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.249s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c461498e-b661-42ed-b2a1-66458f243c7e tempest-VolumesSnapshotTestJSON-1714803349 None] Create snapshot completed successfully
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Flow 'volume_create_manager' (288bdf51-29c0-4ab0-a968-f368c60cd8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e309ab1-28ee-429f-92d2-dbbdd34819b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e309ab1-28ee-429f-92d2-dbbdd34819b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1991884361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c45bcd-8a2b-49b6-b54c-7441815d6e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609767e3201b452fa9e95c05a7c28e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:25Z,use_quota=True,user_id='5214a599cae7432c9d339c5607fc4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c582e601-24a9-4bfc-a225-182ab3ac5ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c582e601-24a9-4bfc-a225-182ab3ac5ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63439f19-7dd8-48bb-8a5c-c8905153901e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63439f19-7dd8-48bb-8a5c-c8905153901e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c45bcd-8a2b-49b6-b54c-7441815d6e22', 'volume_name': 'volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0b09e4-412a-4ea1-b3d4-d75fd42da448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0b09e4-412a-4ea1-b3d4-d75fd42da448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a68b8a9-7682-4651-abc0-3981d9dd1a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Volume 41c45bcd-8a2b-49b6-b54c-7441815d6e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22', 'volume_size': 1}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1991884361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c45bcd-8a2b-49b6-b54c-7441815d6e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609767e3201b452fa9e95c05a7c28e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:25Z,use_quota=True,user_id='5214a599cae7432c9d339c5607fc4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Creating volume 41c45bcd-8a2b-49b6-b54c-7441815d6e22 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:34:24 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:34:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:24 devstack sudo[99388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22 1073741824
Sep 29 12:34:24 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:25 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22 1073741824" returned: 0 in 0.593s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:25 devstack sudo[99404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22
Sep 29 12:34:25 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-ffeee4bb-4abc-4d71-ab72-e62cc2748298 req-7bc595fa-8f76-4636-b81e-753010bdc992 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:25 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22" returned: 0 in 0.330s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-ffeee4bb-4abc-4d71-ab72-e62cc2748298 req-7bc595fa-8f76-4636-b81e-753010bdc992 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.160s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-ffeee4bb-4abc-4d71-ab72-e62cc2748298 req-7bc595fa-8f76-4636-b81e-753010bdc992 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a68b8a9-7682-4651-abc0-3981d9dd1a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b930d403-1815-42ae-953e-685cb82399bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Volume volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22 (41c45bcd-8a2b-49b6-b54c-7441815d6e22): created successfully
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b930d403-1815-42ae-953e-685cb82399bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Flow 'volume_create_manager' (288bdf51-29c0-4ab0-a968-f368c60cd8c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-13a53727-b003-4042-992b-d640952939fd tempest-VolumesActionsTest-2031353854 None] Created volume successfully.
Sep 29 12:34:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-ffeee4bb-4abc-4d71-ab72-e62cc2748298 req-7bc595fa-8f76-4636-b81e-753010bdc992 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-efce0c4e-07c4-4403-b9bc-84436969ab99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44c0884c-2ee6-4892-a4b1-28c9bcc1fdd2', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:34:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-ffeee4bb-4abc-4d71-ab72-e62cc2748298 req-7bc595fa-8f76-4636-b81e-753010bdc992 tempest-TestServerVolumeAttachmentScenario-1044317951 None] attachment_update completed successfully.
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Flow 'volume_create_manager' (1666df42-6811-40a8-a879-86768c661d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0db32ce-30a7-498a-aaea-648629459bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0db32ce-30a7-498a-aaea-648629459bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1611235617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347eba1d-20b2-4ea1-baa0-3a2c429a89e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3de693bc1a4dd7b031b8a8e2d6d25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1259e88c-0522-497d-b07a-8812312a41fd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:26Z,use_quota=True,user_id='37730e3fb580491cb24f5dc5211e2ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d3e265-1a99-4684-81e2-73076f3d4410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d3e265-1a99-4684-81e2-73076f3d4410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa3609c-735f-4f23-bcf9-f3f4f22edf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa3609c-735f-4f23-bcf9-f3f4f22edf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '347eba1d-20b2-4ea1-baa0-3a2c429a89e9', 'volume_name': 'volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9', 'volume_size': 2, 'snapshot_id': '1259e88c-0522-497d-b07a-8812312a41fd'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa774cd-a833-4fd7-a2f7-2e3f18a73470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa774cd-a833-4fd7-a2f7-2e3f18a73470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06124d0a-d1f3-46e5-838e-804b22d08881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume 347eba1d-20b2-4ea1-baa0-3a2c429a89e9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9', 'volume_size': 2, 'snapshot_id': '1259e88c-0522-497d-b07a-8812312a41fd'}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-1259e88c-0522-497d-b07a-8812312a41fd-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-1259e88c-0522-497d-b07a-8812312a41fd-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Creating volume 347eba1d-20b2-4ea1-baa0-3a2c429a89e9 from snapshot 1259e88c-0522-497d-b07a-8812312a41fd {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] snapshot: 1259e88c-0522-497d-b07a-8812312a41fd, volume: 347eba1d-20b2-4ea1-baa0-3a2c429a89e9,  {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2b730b-957c-4f0f-aaff-024f22b11e1b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:26 devstack sudo[99412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Acquiring lock "cinder-41c45bcd-8a2b-49b6-b54c-7441815d6e22-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:26 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Lock "cinder-41c45bcd-8a2b-49b6-b54c-7441815d6e22-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Acquiring lock "cinder-quobyte-41c45bcd-8a2b-49b6-b54c-7441815d6e22" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Lock "cinder-quobyte-41c45bcd-8a2b-49b6-b54c-7441815d6e22" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b1c74c-4f2b-4e6c-b96c-3ee6a65f220a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:27 devstack sudo[99414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22
Sep 29 12:34:27 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:27 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd" returned: 0 in 0.582s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd8567b4-dd78-489d-ac1c-4081d07572bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b455a95-7c37-4303-83b5-d6122f24d211]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:27 devstack sudo[99419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd
Sep 29 12:34:27 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:27 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22" returned: 0 in 0.544s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:27 devstack sudo[99425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22
Sep 29 12:34:27 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:27 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd" returned: 0 in 0.519s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Path /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 12:34:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:27 devstack sudo[99430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9
Sep 29 12:34:27 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:28 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-41c45bcd-8a2b-49b6-b54c-7441815d6e22" returned: 0 in 0.443s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Lock "cinder-quobyte-41c45bcd-8a2b-49b6-b54c-7441815d6e22" released by "delete_volume" :: held 1.071s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Created reservations ['996db260-2f39-44ae-ac2a-7d1880c232db', '6ec12ce2-b6f2-4054-9047-4f9580a44892', '711fc781-ae52-4def-9122-d7f660a16517', '96fbf8d9-9f15-4e9f-8cf6-bced5c393dfa'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:28 devstack sudo[99436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:34:28 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:28 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.369s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:34:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Deleted volume successfully.
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-92873c23-7ad6-419c-a75c-803e000f6dfe tempest-VolumesActionsTest-220787436 None] Lock "cinder-41c45bcd-8a2b-49b6-b54c-7441815d6e22-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-67333d98-78cc-452d-a263-2ae93f108bad req-6ddd718a-6e58-465e-8925-f6127df6ca14 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Terminate volume connection completed successfully.
Sep 29 12:34:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-67333d98-78cc-452d-a263-2ae93f108bad req-6ddd718a-6e58-465e-8925-f6127df6ca14 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Deleting attachment 44c0884c-2ee6-4892-a4b1-28c9bcc1fdd2. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:34:30 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:34:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Flow 'volume_create_manager' (61ea5c50-905f-4d2c-a40b-5a428644ace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e4aaca-fdb5-4f7b-ab0c-3b2c453f8aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e4aaca-fdb5-4f7b-ab0c-3b2c453f8aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-866192871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc42e7e4-0edd-47fa-98db-ba504164955d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609767e3201b452fa9e95c05a7c28e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:30Z,use_quota=True,user_id='5214a599cae7432c9d339c5607fc4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec9ef53-8883-4e9d-bf14-01b4ef267563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec9ef53-8883-4e9d-bf14-01b4ef267563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128c0b26-28f0-4d65-9713-f4df0f3b2495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128c0b26-28f0-4d65-9713-f4df0f3b2495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc42e7e4-0edd-47fa-98db-ba504164955d', 'volume_name': 'volume-cc42e7e4-0edd-47fa-98db-ba504164955d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a244aa-00c5-407d-9bb3-37415dcbd802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a244aa-00c5-407d-9bb3-37415dcbd802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dca5f5c-f837-4331-b3c8-ce670dcd50d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:30 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Volume cc42e7e4-0edd-47fa-98db-ba504164955d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc42e7e4-0edd-47fa-98db-ba504164955d', 'volume_size': 1}
Sep 29 12:34:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:32 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=133,cinder:INSERT=38,cinder:UPDATE=133,cinder:DELETE=8 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:34:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-de3dfa5e-a5ab-4e3b-9819-cf7953dd3b3f req-13249547-d52e-4096-8a51-440f95c7d876 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Terminate volume connection completed successfully.
Sep 29 12:34:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-de3dfa5e-a5ab-4e3b-9819-cf7953dd3b3f req-13249547-d52e-4096-8a51-440f95c7d876 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Deleting attachment bbfcc41e-c7e5-4b9c-b5f9-dbb4814cd8c0. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:34:37 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" returned: 0 in 9.729s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:37 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd, size 1024.00 MB, duration 9.73 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:34:37 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Converted 1024.00 MB image at 105.25 MB/s
Sep 29 12:34:37 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9 is being set with open permissions: ugo+rw
Sep 29 12:34:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:37 devstack sudo[99507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9
Sep 29 12:34:37 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:37 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" returned: 0 in 0.280s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" released by "_copy_volume_from_snapshot" :: held 11.303s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-1259e88c-0522-497d-b07a-8812312a41fd-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" released by "_create_volume_from_snapshot" :: held 11.441s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.465s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.254s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-866192871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc42e7e4-0edd-47fa-98db-ba504164955d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609767e3201b452fa9e95c05a7c28e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:30Z,use_quota=True,user_id='5214a599cae7432c9d339c5607fc4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Creating volume cc42e7e4-0edd-47fa-98db-ba504164955d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:34:38 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc42e7e4-0edd-47fa-98db-ba504164955d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:38 devstack sudo[99511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc42e7e4-0edd-47fa-98db-ba504164955d 1073741824
Sep 29 12:34:38 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06124d0a-d1f3-46e5-838e-804b22d08881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9', 'volume_size': 2, 'snapshot_id': '1259e88c-0522-497d-b07a-8812312a41fd'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34061c57-e562-471c-bd7e-15b10709cd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:38 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9 (347eba1d-20b2-4ea1-baa0-3a2c429a89e9): created successfully
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34061c57-e562-471c-bd7e-15b10709cd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Flow 'volume_create_manager' (1666df42-6811-40a8-a879-86768c661d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-514570e4-0392-4a99-8cc2-b01c3f7169f9 tempest-VolumesSnapshotTestJSON-1714803349 None] Created volume successfully.
Sep 29 12:34:38 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc42e7e4-0edd-47fa-98db-ba504164955d 1073741824" returned: 0 in 0.699s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc42e7e4-0edd-47fa-98db-ba504164955d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:38 devstack sudo[99517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc42e7e4-0edd-47fa-98db-ba504164955d
Sep 29 12:34:38 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-347eba1d-20b2-4ea1-baa0-3a2c429a89e9-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-347eba1d-20b2-4ea1-baa0-3a2c429a89e9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a788ee-5c8f-45e2-84c1-9d99945e1e4f]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:39 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc42e7e4-0edd-47fa-98db-ba504164955d" returned: 0 in 0.360s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:39 devstack sudo[99519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9
Sep 29 12:34:39 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dca5f5c-f837-4331-b3c8-ce670dcd50d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc42e7e4-0edd-47fa-98db-ba504164955d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4534b9e1-0238-4b3f-a432-5ebe53c797fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:39 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Volume volume-cc42e7e4-0edd-47fa-98db-ba504164955d (cc42e7e4-0edd-47fa-98db-ba504164955d): created successfully
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4534b9e1-0238-4b3f-a432-5ebe53c797fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Flow 'volume_create_manager' (61ea5c50-905f-4d2c-a40b-5a428644ace7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a5e62fdc-b3e4-4a9e-a10c-7088b31a70fd tempest-VolumesActionsTest-2031353854 None] Created volume successfully.
Sep 29 12:34:39 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" returned: 0 in 0.451s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:39 devstack sudo[99525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9
Sep 29 12:34:39 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:39 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" returned: 0 in 0.328s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-347eba1d-20b2-4ea1-baa0-3a2c429a89e9" released by "delete_volume" :: held 0.832s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Acquiring lock "cinder-cc42e7e4-0edd-47fa-98db-ba504164955d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Lock "cinder-cc42e7e4-0edd-47fa-98db-ba504164955d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Acquiring lock "cinder-quobyte-cc42e7e4-0edd-47fa-98db-ba504164955d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Created reservations ['eb62f7e3-0ff6-4881-81c3-8d727fdd21ff', '84f9ee0f-f3c2-4397-8424-e4f7db36a78e', '86686d2f-1ee5-456d-9f0f-1ac81b870a7d', '8ceddba3-67f6-4a1f-ac18-af5c4c1faadf'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Lock "cinder-quobyte-cc42e7e4-0edd-47fa-98db-ba504164955d" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c438bae5-1b27-46f0-aa07-c5cfc43375a5]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc42e7e4-0edd-47fa-98db-ba504164955d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:40 devstack sudo[99528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc42e7e4-0edd-47fa-98db-ba504164955d
Sep 29 12:34:40 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:40 devstack sudo[99529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:34:40 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:40 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.441s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:34:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Deleted volume successfully.
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e9dfc03e-8152-42bb-a245-e15135b7d90c tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-347eba1d-20b2-4ea1-baa0-3a2c429a89e9-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:40 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc42e7e4-0edd-47fa-98db-ba504164955d" returned: 0 in 0.598s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc42e7e4-0edd-47fa-98db-ba504164955d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:40 devstack sudo[99536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc42e7e4-0edd-47fa-98db-ba504164955d
Sep 29 12:34:40 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:40 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cc42e7e4-0edd-47fa-98db-ba504164955d" returned: 0 in 0.304s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Lock "cinder-quobyte-cc42e7e4-0edd-47fa-98db-ba504164955d" released by "delete_volume" :: held 0.982s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Created reservations ['959722c8-9a0b-4ee6-ba69-b492d44d6373', 'd1b1a7a3-9d94-4d9f-8ee1-9b1b0b7dfbc3', '75d6b65d-b7a6-43fd-8a44-d81380a06ab0', 'c962a3eb-7d08-4209-8e68-94515f2b70c9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Acquiring lock "cinder-efce0c4e-07c4-4403-b9bc-84436969ab99-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "cinder-efce0c4e-07c4-4403-b9bc-84436969ab99-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:41 devstack sudo[99539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:34:41 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-1259e88c-0522-497d-b07a-8812312a41fd-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Acquiring lock "cinder-quobyte-efce0c4e-07c4-4403-b9bc-84436969ab99" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "cinder-quobyte-efce0c4e-07c4-4403-b9bc-84436969ab99" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-1259e88c-0522-497d-b07a-8812312a41fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-cd8567b4-dd78-489d-ac1c-4081d07572bd" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-cd8567b4-dd78-489d-ac1c-4081d07572bd" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-1259e88c-0522-497d-b07a-8812312a41fd" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b321f97a-7e29-4b85-be2d-fbad89e4b50b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-efce0c4e-07c4-4403-b9bc-84436969ab99 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-1259e88c-0522-497d-b07a-8812312a41fd" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Deleting offline snapshot 1259e88c-0522-497d-b07a-8812312a41fd of volume cd8567b4-dd78-489d-ac1c-4081d07572bd {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] snapshot_file for this snap is: volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd29f724-19d8-496a-aadd-c4231629b258]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:41 devstack sudo[99541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-efce0c4e-07c4-4403-b9bc-84436969ab99
Sep 29 12:34:41 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:41 devstack sudo[99542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd
Sep 29 12:34:41 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:41 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.498s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:34:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Deleted volume successfully.
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-68036a13-2db3-44f4-b839-395eee3f1bcc tempest-VolumesActionsTest-220787436 None] Lock "cinder-cc42e7e4-0edd-47fa-98db-ba504164955d-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:41 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-efce0c4e-07c4-4403-b9bc-84436969ab99" returned: 0 in 0.578s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-efce0c4e-07c4-4403-b9bc-84436969ab99 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:41 devstack sudo[99552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-efce0c4e-07c4-4403-b9bc-84436969ab99
Sep 29 12:34:41 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:42 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd" returned: 0 in 0.548s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd8567b4-dd78-489d-ac1c-4081d07572bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bb24fa-0df4-4015-9f1c-bb334c230867]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:42 devstack sudo[99555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd
Sep 29 12:34:42 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:42 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-efce0c4e-07c4-4403-b9bc-84436969ab99" returned: 0 in 0.463s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "cinder-quobyte-efce0c4e-07c4-4403-b9bc-84436969ab99" released by "delete_volume" :: held 1.145s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Created reservations ['ae9c1f08-e533-49e1-bf78-b8673d696b65', 'd7b6ca45-eaa8-4c06-beda-b3045ec73a65', '9dda2be5-2e81-4786-916c-ae73d0a188d7', '137f25f9-36c9-48d9-8d84-c8b13785155d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:42 devstack sudo[99560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:34:42 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:42 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd" returned: 0 in 0.857s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:42 devstack sudo[99565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd
Sep 29 12:34:42 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:43 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.386s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:34:43 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Deleted volume successfully.
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b48f00a5-8cd6-423e-97f2-d3c9fa643c26 tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "cinder-efce0c4e-07c4-4403-b9bc-84436969ab99-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Flow 'volume_create_manager' (9b08cf1b-92ae-40cd-8a46-a29d49dc155b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56308263-e064-4d32-a979-827f052c8c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56308263-e064-4d32-a979-827f052c8c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-239442204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23b2ef3-bb80-48c4-a039-1d99f341898d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609767e3201b452fa9e95c05a7c28e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:43Z,use_quota=True,user_id='5214a599cae7432c9d339c5607fc4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e30597c-d3e0-48e2-a54f-14b634809367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e30597c-d3e0-48e2-a54f-14b634809367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c3d7a8-c6d0-4459-9cc5-0b901356594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c3d7a8-c6d0-4459-9cc5-0b901356594d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f23b2ef3-bb80-48c4-a039-1d99f341898d', 'volume_name': 'volume-f23b2ef3-bb80-48c4-a039-1d99f341898d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a183c178-d981-4167-bfaa-6b7620d8314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a183c178-d981-4167-bfaa-6b7620d8314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9358a1f3-3d27-4afd-a587-25781ab1cb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:43 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Volume f23b2ef3-bb80-48c4-a039-1d99f341898d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f23b2ef3-bb80-48c4-a039-1d99f341898d', 'volume_size': 1}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-239442204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23b2ef3-bb80-48c4-a039-1d99f341898d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609767e3201b452fa9e95c05a7c28e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:43Z,use_quota=True,user_id='5214a599cae7432c9d339c5607fc4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Creating volume f23b2ef3-bb80-48c4-a039-1d99f341898d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:34:43 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f23b2ef3-bb80-48c4-a039-1d99f341898d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:43 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f23b2ef3-bb80-48c4-a039-1d99f341898d 1073741824
Sep 29 12:34:43 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:43 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd" returned: 0 in 0.541s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:43 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd
Sep 29 12:34:43 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Acquiring lock "cinder-f34a5bf5-43d2-4a60-8da9-8e8920862132-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "cinder-f34a5bf5-43d2-4a60-8da9-8e8920862132-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Acquiring lock "cinder-quobyte-f34a5bf5-43d2-4a60-8da9-8e8920862132" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "cinder-quobyte-f34a5bf5-43d2-4a60-8da9-8e8920862132" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa7f17f-7eb2-42ac-b5e4-dc5443da09c2]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f34a5bf5-43d2-4a60-8da9-8e8920862132 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:43 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd.1259e88c-0522-497d-b07a-8812312a41fd" returned: 0 in 0.372s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:43 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f23b2ef3-bb80-48c4-a039-1d99f341898d 1073741824" returned: 0 in 0.744s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:43 devstack sudo[99579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f34a5bf5-43d2-4a60-8da9-8e8920862132
Sep 29 12:34:43 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-1259e88c-0522-497d-b07a-8812312a41fd" released by "_delete_snapshot" :: held 2.591s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-cd8567b4-dd78-489d-ac1c-4081d07572bd" released by "delete_snapshot" :: held 2.658s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f23b2ef3-bb80-48c4-a039-1d99f341898d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:44 devstack sudo[99582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f23b2ef3-bb80-48c4-a039-1d99f341898d
Sep 29 12:34:44 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Created reservations ['01ffdb5e-4279-49be-9117-4e92300538c8', 'fb4fb59c-c64f-4afe-8b4c-f6cb7888e77e', '122784c8-2a7e-4356-8006-7a7590ac2480', '9b297a00-f5a3-4977-9816-4fa72f4a3149'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Delete snapshot completed successfully.
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16c43c2b-9524-4a33-b0a2-226ea6767d28 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-1259e88c-0522-497d-b07a-8812312a41fd-delete_snapshot" released by "delete_snapshot" :: held 2.961s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:44 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f34a5bf5-43d2-4a60-8da9-8e8920862132" returned: 0 in 0.559s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f34a5bf5-43d2-4a60-8da9-8e8920862132 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:44 devstack sudo[99589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f34a5bf5-43d2-4a60-8da9-8e8920862132
Sep 29 12:34:44 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:44 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f23b2ef3-bb80-48c4-a039-1d99f341898d" returned: 0 in 0.383s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9358a1f3-3d27-4afd-a587-25781ab1cb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23b2ef3-bb80-48c4-a039-1d99f341898d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869a4422-050f-4ed4-ba4b-d38309ec11af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:44 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Volume volume-f23b2ef3-bb80-48c4-a039-1d99f341898d (f23b2ef3-bb80-48c4-a039-1d99f341898d): created successfully
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869a4422-050f-4ed4-ba4b-d38309ec11af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Flow 'volume_create_manager' (9b08cf1b-92ae-40cd-8a46-a29d49dc155b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c12beb6f-4767-4f91-89a8-e07d0cdfb6e2 tempest-VolumesActionsTest-2031353854 None] Created volume successfully.
Sep 29 12:34:44 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f34a5bf5-43d2-4a60-8da9-8e8920862132" returned: 0 in 0.335s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "cinder-quobyte-f34a5bf5-43d2-4a60-8da9-8e8920862132" released by "delete_volume" :: held 0.969s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-cd8567b4-dd78-489d-ac1c-4081d07572bd-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-cd8567b4-dd78-489d-ac1c-4081d07572bd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-cd8567b4-dd78-489d-ac1c-4081d07572bd" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Created reservations ['21bd6c8a-9e4d-41dd-baaf-cdd14d17c3f0', '54ccc944-3788-4f87-a008-ab511bab10a5', '6e9ba132-7b39-41a4-9cd5-0c58a9d3d5d1', '9c677d64-3e7c-482e-8feb-7ca94d659150'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-cd8567b4-dd78-489d-ac1c-4081d07572bd" acquired by "delete_volume" :: waited 0.044s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d36382d-897a-435b-a646-cf84253fc675]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:45 devstack sudo[99593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd
Sep 29 12:34:45 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:45 devstack sudo[99594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:34:45 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:45 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.351s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:34:45 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Deleted volume successfully.
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Acquiring lock "cinder-f23b2ef3-bb80-48c4-a039-1d99f341898d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-784ce848-04f3-46dc-a97f-afa78dddeead tempest-TestServerVolumeAttachmentScenario-1044317951 None] Lock "cinder-f34a5bf5-43d2-4a60-8da9-8e8920862132-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Lock "cinder-f23b2ef3-bb80-48c4-a039-1d99f341898d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:45 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd" returned: 0 in 0.632s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Acquiring lock "cinder-quobyte-f23b2ef3-bb80-48c4-a039-1d99f341898d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:45 devstack sudo[99601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Lock "cinder-quobyte-f23b2ef3-bb80-48c4-a039-1d99f341898d" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:45 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fcc77a-234e-4383-a6e6-c7be4a6a0551]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f23b2ef3-bb80-48c4-a039-1d99f341898d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:45 devstack sudo[99603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f23b2ef3-bb80-48c4-a039-1d99f341898d
Sep 29 12:34:45 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:45 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-cd8567b4-dd78-489d-ac1c-4081d07572bd" returned: 0 in 0.390s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-cd8567b4-dd78-489d-ac1c-4081d07572bd" released by "delete_volume" :: held 1.137s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Created reservations ['36871694-1190-4d71-9fd0-919a3994cbd9', 'bb5cd917-f4e0-44d3-9c26-c651cc0cf2d3', 'ccc82355-7841-4a2f-b9a7-e51f4b3912f2', 'e41b7dda-9932-424f-8256-32db579ae166'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:46 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f23b2ef3-bb80-48c4-a039-1d99f341898d" returned: 0 in 0.543s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f23b2ef3-bb80-48c4-a039-1d99f341898d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:46 devstack sudo[99609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:34:46 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:46 devstack sudo[99610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f23b2ef3-bb80-48c4-a039-1d99f341898d
Sep 29 12:34:46 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:46 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.303s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:34:46 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Deleted volume successfully.
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16e81623-0311-4eb2-9a27-af0d8c4d2cb5 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-cd8567b4-dd78-489d-ac1c-4081d07572bd-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:46 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f23b2ef3-bb80-48c4-a039-1d99f341898d" returned: 0 in 0.364s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Lock "cinder-quobyte-f23b2ef3-bb80-48c4-a039-1d99f341898d" released by "delete_volume" :: held 0.969s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Created reservations ['7775a288-faef-4b1e-90e1-1cf2f9e2ef05', 'fc242ace-fc7a-4482-8ab5-be58878b84df', 'f4fcc7ea-2fd7-42c7-b195-2ffe5c192284', '460a799f-b38d-4fa9-a1d9-5189ecade491'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:46 devstack sudo[99615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:34:46 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:47 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:34:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Deleted volume successfully.
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8f892a87-c02d-4398-a890-6d11ffb7d825 tempest-VolumesActionsTest-220787436 None] Lock "cinder-f23b2ef3-bb80-48c4-a039-1d99f341898d-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Flow 'volume_create_manager' (a3e9ec7a-53b0-4fb3-9317-de10c43afa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e5315a-6d0b-464b-90b0-03bb70a853bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e5315a-6d0b-464b-90b0-03bb70a853bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1318227824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd39a6a-cd15-4f6d-aabe-78e9274879b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3de693bc1a4dd7b031b8a8e2d6d25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:48Z,use_quota=True,user_id='37730e3fb580491cb24f5dc5211e2ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15deb05-972f-483b-881b-69eee003eacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15deb05-972f-483b-881b-69eee003eacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a07361-1ba9-40bc-93ac-9294aaf771bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a07361-1ba9-40bc-93ac-9294aaf771bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd39a6a-cd15-4f6d-aabe-78e9274879b6', 'volume_name': 'volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae628c2-1205-4274-a48a-5ed92134614b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae628c2-1205-4274-a48a-5ed92134614b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d004afb6-7641-4763-a29f-b498750297fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:47 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume edd39a6a-cd15-4f6d-aabe-78e9274879b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6', 'volume_size': 1}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1318227824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd39a6a-cd15-4f6d-aabe-78e9274879b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3de693bc1a4dd7b031b8a8e2d6d25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:48Z,use_quota=True,user_id='37730e3fb580491cb24f5dc5211e2ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Creating volume edd39a6a-cd15-4f6d-aabe-78e9274879b6 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:34:47 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:34:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:47 devstack sudo[99618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 1073741824
Sep 29 12:34:47 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:48 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 1073741824" returned: 0 in 0.650s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:34:48 devstack sudo[99625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6
Sep 29 12:34:48 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Flow 'volume_create_manager' (b625979e-c627-4981-a3c4-01179abc728f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9236f2e-ea21-4d54-b1c2-798212d9bbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9236f2e-ea21-4d54-b1c2-798212d9bbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1710147289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496642cc-6193-497a-8596-8e1f65d4fdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609767e3201b452fa9e95c05a7c28e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:49Z,use_quota=True,user_id='5214a599cae7432c9d339c5607fc4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175191b2-29b7-4ad0-b3e1-4f5a5082c182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175191b2-29b7-4ad0-b3e1-4f5a5082c182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f411460-2381-444b-8663-800962067df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f411460-2381-444b-8663-800962067df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496642cc-6193-497a-8596-8e1f65d4fdac', 'volume_name': 'volume-496642cc-6193-497a-8596-8e1f65d4fdac', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648fa8d2-5d90-4b42-a8a3-fa295d3529de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648fa8d2-5d90-4b42-a8a3-fa295d3529de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65bbf8c2-d494-4217-ae19-6b620a49539f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:48 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Volume 496642cc-6193-497a-8596-8e1f65d4fdac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496642cc-6193-497a-8596-8e1f65d4fdac', 'volume_size': 1}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:48 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6" returned: 0 in 0.385s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.242s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1710147289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496642cc-6193-497a-8596-8e1f65d4fdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609767e3201b452fa9e95c05a7c28e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:49Z,use_quota=True,user_id='5214a599cae7432c9d339c5607fc4959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Creating volume 496642cc-6193-497a-8596-8e1f65d4fdac {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:34:48 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:34:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-496642cc-6193-497a-8596-8e1f65d4fdac 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d004afb6-7641-4763-a29f-b498750297fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99e5f0b-b7ec-4585-8006-b0996a3d6fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:49 devstack sudo[99628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-496642cc-6193-497a-8596-8e1f65d4fdac 1073741824
Sep 29 12:34:49 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 (edd39a6a-cd15-4f6d-aabe-78e9274879b6): created successfully
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99e5f0b-b7ec-4585-8006-b0996a3d6fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Flow 'volume_create_manager' (a3e9ec7a-53b0-4fb3-9317-de10c43afa6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:49 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5d7e40f3-2ea5-45aa-847a-fc879d43cf25 tempest-VolumesSnapshotTestJSON-1714803349 None] Created volume successfully.
Sep 29 12:34:49 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-496642cc-6193-497a-8596-8e1f65d4fdac 1073741824" returned: 0 in 0.560s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-496642cc-6193-497a-8596-8e1f65d4fdac {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:49 devstack sudo[99634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-496642cc-6193-497a-8596-8e1f65d4fdac
Sep 29 12:34:49 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:49 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-496642cc-6193-497a-8596-8e1f65d4fdac" returned: 0 in 0.306s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65bbf8c2-d494-4217-ae19-6b620a49539f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496642cc-6193-497a-8596-8e1f65d4fdac', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a433982-d13d-4794-934e-772c6537a872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Volume volume-496642cc-6193-497a-8596-8e1f65d4fdac (496642cc-6193-497a-8596-8e1f65d4fdac): created successfully
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a433982-d13d-4794-934e-772c6537a872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Flow 'volume_create_manager' (b625979e-c627-4981-a3c4-01179abc728f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:49 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2dcfa3f8-7242-45f3-ac8f-5a8c22d8262e tempest-VolumesActionsTest-2031353854 None] Created volume successfully.
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] Creating offline snapshot 5af0061b-4d6e-4af1-891b-a4c65add827e of volume edd39a6a-cd15-4f6d-aabe-78e9274879b6 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac0a7e7-70aa-405d-b65a-f626491935d7]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:50 devstack sudo[99637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6
Sep 29 12:34:50 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Flow 'volume_create_manager' (3e3c63b7-2841-4181-984c-fa24bcbc1230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28314bde-edd8-455b-a0e9-35a3ee51a448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28314bde-edd8-455b-a0e9-35a3ee51a448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1377942500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='773b13fc8310415194f647932da523b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:51Z,use_quota=True,user_id='744ae850235c4b039062b864d55d8c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab29930-00c7-481f-af23-d92dc972f4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab29930-00c7-481f-af23-d92dc972f4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75961c0b-b350-4473-80d0-afbb823d06f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 12:34:50 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6" returned: 0 in 0.456s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:50 devstack sudo[99642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e 1G
Sep 29 12:34:50 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75961c0b-b350-4473-80d0-afbb823d06f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd', 'volume_name': 'volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701b28cb90>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650ae8be-08cb-4398-9b3b-395005f5abd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650ae8be-08cb-4398-9b3b-395005f5abd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fc8f72-9b30-4406-a486-3831db5ed913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:51 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Volume fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701b28cb90>}
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Trying to clone fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd from image f8e17489-d113-49d7-ab01-94ac91f04646 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 12:34:51 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e 1G" returned: 0 in 0.770s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:51 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e
Sep 29 12:34:51 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 12:34:51 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Acquiring lock "cinder-496642cc-6193-497a-8596-8e1f65d4fdac-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Lock "cinder-496642cc-6193-497a-8596-8e1f65d4fdac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8327f703-4d51-4b2e-bd19-c837faae5f20]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Acquiring lock "cinder-quobyte-496642cc-6193-497a-8596-8e1f65d4fdac" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Lock "cinder-quobyte-496642cc-6193-497a-8596-8e1f65d4fdac" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:51 devstack sudo[99651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD
Sep 29 12:34:51 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[111949ed-16ea-442a-9c84-7550d557f1fa]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-496642cc-6193-497a-8596-8e1f65d4fdac {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:51 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e" returned: 0 in 0.478s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:51 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e is being set with open permissions: ugo+rw
Sep 29 12:34:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:51 devstack sudo[99657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e
Sep 29 12:34:51 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:51 devstack sudo[99655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-496642cc-6193-497a-8596-8e1f65d4fdac
Sep 29 12:34:51 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:52 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Temporary image f8e17489-d113-49d7-ab01-94ac91f04646 is fetched for user 744ae850235c4b039062b864d55d8c4c. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[88714468-33e3-42e0-8d6a-4909a80e61d3]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:52 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e" returned: 0 in 0.335s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:52 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:52 devstack sudo[99666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD
Sep 29 12:34:52 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-496642cc-6193-497a-8596-8e1f65d4fdac" returned: 0 in 0.475s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-496642cc-6193-497a-8596-8e1f65d4fdac {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:52 devstack sudo[99669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.info
Sep 29 12:34:52 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:52 devstack sudo[99671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-496642cc-6193-497a-8596-8e1f65d4fdac
Sep 29 12:34:52 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:52 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:52 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-496642cc-6193-497a-8596-8e1f65d4fdac" returned: 0 in 0.406s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Lock "cinder-quobyte-496642cc-6193-497a-8596-8e1f65d4fdac" released by "delete_volume" :: held 0.961s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:52 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.info" returned: 0 in 0.484s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:52 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.info is being set with open permissions: ugo+rw
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:52 devstack sudo[99714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.info
Sep 29 12:34:52 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Created reservations ['4ab99a96-347c-4e4f-9a39-09ace87b791b', '4ff14927-4ec6-4d9d-addf-8a6c9cea7b92', '9230e4b9-80a0-406e-ad68-47cfae303748', '54db26f3-83ff-44b0-ac40-0fdb210de8da'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:53 devstack sudo[99716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:34:53 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:53 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.info" returned: 0 in 0.335s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.982s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1377942500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='773b13fc8310415194f647932da523b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:51Z,use_quota=True,user_id='744ae850235c4b039062b864d55d8c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Creating volume fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:34:53 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:53 devstack sudo[99721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd 1073741824
Sep 29 12:34:53 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e3ee79a1-6ecc-41e1-afff-426931c5b348 tempest-VolumesSnapshotTestJSON-1714803349 None] Create snapshot completed successfully
Sep 29 12:34:53 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.314s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:34:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Deleted volume successfully.
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c0e5b402-758d-4ff0-b71b-96d1698a6b3f tempest-VolumesActionsTest-2031353854 None] Lock "cinder-496642cc-6193-497a-8596-8e1f65d4fdac-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:34:53 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd 1073741824" returned: 0 in 0.580s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:53 devstack sudo[99728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd
Sep 29 12:34:53 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:54 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd" returned: 0 in 0.299s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Attempting download of f8e17489-d113-49d7-ab01-94ac91f04646 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}])) to volume fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Flow 'volume_create_manager' (ab3a8032-bd32-4188-8f06-fe7db044c991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990f4d3f-3316-425f-8dd8-545d07da34f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990f4d3f-3316-425f-8dd8-545d07da34f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1089189579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcc761f-a3de-46fa-8667-0a117870deb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3de693bc1a4dd7b031b8a8e2d6d25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5af0061b-4d6e-4af1-891b-a4c65add827e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:34:54Z,use_quota=True,user_id='37730e3fb580491cb24f5dc5211e2ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450fa2c2-9721-4c94-bfbd-0ab9a4f0a791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450fa2c2-9721-4c94-bfbd-0ab9a4f0a791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9714fd01-d455-43b2-a4b6-9fe0abf85d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9714fd01-d455-43b2-a4b6-9fe0abf85d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'afcc761f-a3de-46fa-8667-0a117870deb9', 'volume_name': 'volume-afcc761f-a3de-46fa-8667-0a117870deb9', 'volume_size': 1, 'snapshot_id': '5af0061b-4d6e-4af1-891b-a4c65add827e'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797fdc90-fa00-4d1f-80de-5c750b751670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797fdc90-fa00-4d1f-80de-5c750b751670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc463f30-971c-4265-8daa-3209d4141e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:34:54 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume afcc761f-a3de-46fa-8667-0a117870deb9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-afcc761f-a3de-46fa-8667-0a117870deb9', 'volume_size': 1, 'snapshot_id': '5af0061b-4d6e-4af1-891b-a4c65add827e'}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[df878bb8-884c-41ca-a5b9-44a812fdc0b1]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_rvwf1igp {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-5af0061b-4d6e-4af1-891b-a4c65add827e-afcc761f-a3de-46fa-8667-0a117870deb9" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-5af0061b-4d6e-4af1-891b-a4c65add827e-afcc761f-a3de-46fa-8667-0a117870deb9" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Creating volume afcc761f-a3de-46fa-8667-0a117870deb9 from snapshot 5af0061b-4d6e-4af1-891b-a4c65add827e {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-afcc761f-a3de-46fa-8667-0a117870deb9" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-afcc761f-a3de-46fa-8667-0a117870deb9" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] snapshot: 5af0061b-4d6e-4af1-891b-a4c65add827e, volume: afcc761f-a3de-46fa-8667-0a117870deb9,  {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 12:34:54 devstack sudo[99732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_rvwf1igp
Sep 29 12:34:54 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa1ad74-04d5-4291-bdcc-57fec70286fb]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:54 devstack sudo[99735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e
Sep 29 12:34:54 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:54 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_rvwf1igp" returned: 0 in 0.409s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_rvwf1igp {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:54 devstack sudo[99739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_rvwf1igp
Sep 29 12:34:54 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:54 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e" returned: 0 in 0.487s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e176c8e6-5a97-4240-85d5-0b87b7e1cdfb]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:55 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_rvwf1igp" returned: 1 in 0.388s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_rvwf1igp' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:34:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d027d8ad-4378-4ae6-afa3-50860af1fa5a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:34:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:55 devstack sudo[99744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6
Sep 29 12:34:55 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:55 devstack sudo[99747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD
Sep 29 12:34:55 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:55 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6" returned: 0 in 0.487s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 12:34:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 12:34:55 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Path /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 12:34:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:55 devstack sudo[99757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9
Sep 29 12:34:55 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:34:55 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root
Sep 29 12:34:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:34:55 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] f8e17489-d113-49d7-ab01-94ac91f04646 was qcow2, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 12:34:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:34:55 devstack sudo[99759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd
Sep 29 12:34:55 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:01 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd" returned: 0 in 6.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:01 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_4racb0fvdevstack@QuobyteHD, size 112.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:35:01 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Converted 112.00 MB image at 17.79 MB/s
Sep 29 12:35:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:01 devstack sudo[99794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd 1G
Sep 29 12:35:01 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:02 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd 1G" returned: 0 in 0.838s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:02 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Downloaded image f8e17489-d113-49d7-ab01-94ac91f04646 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}])) to volume fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 12:35:02 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Temporary image f8e17489-d113-49d7-ab01-94ac91f04646 for user 744ae850235c4b039062b864d55d8c4c is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 12:35:02 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Marking volume fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 12:35:02 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=154,cinder:INSERT=35,cinder:UPDATE=155,cinder:DELETE=10 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:35:02 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Copying metadata from image f8e17489-d113-49d7-ab01-94ac91f04646 to fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 12:35:02 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Creating volume glance metadata for volume fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd backed by image f8e17489-d113-49d7-ab01-94ac91f04646 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 12:35:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fc8f72-9b30-4406-a486-3831db5ed913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701b28cb90>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0d8a6d-491b-4e67-9b3a-28f00858995e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:02 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Volume volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd (fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd): created successfully
Sep 29 12:35:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0d8a6d-491b-4e67-9b3a-28f00858995e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Flow 'volume_create_manager' (3e3c63b7-2841-4181-984c-fa24bcbc1230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:35:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-94ff05f4-4e4b-46c3-bd46-154762d1bfc2 tempest-TestShelveInstance-1211941693 None] Created volume successfully.
Sep 29 12:35:05 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9" returned: 0 in 9.712s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:05 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6, size 1024.00 MB, duration 9.71 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:35:05 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Converted 1024.00 MB image at 105.43 MB/s
Sep 29 12:35:05 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9 is being set with open permissions: ugo+rw
Sep 29 12:35:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:05 devstack sudo[99802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9
Sep 29 12:35:05 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:05 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9" returned: 0 in 0.313s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-afcc761f-a3de-46fa-8667-0a117870deb9" released by "_copy_volume_from_snapshot" :: held 11.156s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-5af0061b-4d6e-4af1-891b-a4c65add827e-afcc761f-a3de-46fa-8667-0a117870deb9" released by "_create_volume_from_snapshot" :: held 11.253s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.277s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:35:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc463f30-971c-4265-8daa-3209d4141e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afcc761f-a3de-46fa-8667-0a117870deb9', 'volume_size': 1, 'snapshot_id': '5af0061b-4d6e-4af1-891b-a4c65add827e'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d643c29-1e11-447f-9df8-fbc601a83d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Volume volume-afcc761f-a3de-46fa-8667-0a117870deb9 (afcc761f-a3de-46fa-8667-0a117870deb9): created successfully
Sep 29 12:35:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d643c29-1e11-447f-9df8-fbc601a83d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Flow 'volume_create_manager' (ab3a8032-bd32-4188-8f06-fe7db044c991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:35:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-139998f4-ae18-4389-8c6b-6a7e86dd3ee8 tempest-VolumesSnapshotTestJSON-1714803349 None] Created volume successfully.
Sep 29 12:35:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-afcc761f-a3de-46fa-8667-0a117870deb9-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:35:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-afcc761f-a3de-46fa-8667-0a117870deb9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:35:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-afcc761f-a3de-46fa-8667-0a117870deb9" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:35:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-afcc761f-a3de-46fa-8667-0a117870deb9" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:35:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eab79a-f69b-4766-b0f7-a926edcd509f]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:06 devstack sudo[99807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9
Sep 29 12:35:06 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:07 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9" returned: 0 in 0.486s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:07 devstack sudo[99813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9
Sep 29 12:35:07 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:07 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-afcc761f-a3de-46fa-8667-0a117870deb9" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-afcc761f-a3de-46fa-8667-0a117870deb9" released by "delete_volume" :: held 0.848s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Created reservations ['0204faae-c334-417c-990f-ef149fa25ecc', '3a982f4a-9e6f-4130-80fc-7fece434447c', 'a1a753b5-1d2d-44ce-9231-34311dfce58f', 'a1363e56-43c7-4880-aa48-22aafd21425c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:07 devstack sudo[99821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:35:07 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:07 devstack sudo[99823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:35:07 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-5af0061b-4d6e-4af1-891b-a4c65add827e-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-5af0061b-4d6e-4af1-891b-a4c65add827e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-edd39a6a-cd15-4f6d-aabe-78e9274879b6" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-edd39a6a-cd15-4f6d-aabe-78e9274879b6" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-5af0061b-4d6e-4af1-891b-a4c65add827e" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-5af0061b-4d6e-4af1-891b-a4c65add827e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Deleting offline snapshot 5af0061b-4d6e-4af1-891b-a4c65add827e of volume edd39a6a-cd15-4f6d-aabe-78e9274879b6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] snapshot_file for this snap is: volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36f5137-5630-430e-a816-0e3d914e1c3f]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:08 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.502s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:35:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Deleted volume successfully.
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f0d641b1-5890-4dd0-9086-33dfc62e0943 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-afcc761f-a3de-46fa-8667-0a117870deb9-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:08 devstack sudo[99826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e
Sep 29 12:35:08 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:08 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.624s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:35:08 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e" returned: 0 in 0.584s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f936c08-8d21-45b9-80ab-8a2b4ec93ed1]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:08 devstack sudo[99832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6
Sep 29 12:35:08 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:09 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6" returned: 0 in 0.756s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:09 devstack sudo[99838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e
Sep 29 12:35:09 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-bcab41f5-3b9c-4814-ae12-02d632dd1cf5 req-02300c63-934d-430b-8b96-1daca4f0e9de tempest-TestShelveInstance-1211941693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:35:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-bcab41f5-3b9c-4814-ae12-02d632dd1cf5 req-02300c63-934d-430b-8b96-1daca4f0e9de tempest-TestShelveInstance-1211941693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:35:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-bcab41f5-3b9c-4814-ae12-02d632dd1cf5 req-02300c63-934d-430b-8b96-1daca4f0e9de tempest-TestShelveInstance-1211941693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:35:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-bcab41f5-3b9c-4814-ae12-02d632dd1cf5 req-02300c63-934d-430b-8b96-1daca4f0e9de tempest-TestShelveInstance-1211941693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5620de37-36c1-457f-8a7c-a10a8f1b7d5a', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:35:10 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e" returned: 0 in 0.649s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-bcab41f5-3b9c-4814-ae12-02d632dd1cf5 req-02300c63-934d-430b-8b96-1daca4f0e9de tempest-TestShelveInstance-1211941693 None] attachment_update completed successfully.
Sep 29 12:35:10 devstack sudo[99851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e
Sep 29 12:35:10 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:10 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6.5af0061b-4d6e-4af1-891b-a4c65add827e" returned: 0 in 0.441s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-5af0061b-4d6e-4af1-891b-a4c65add827e" released by "_delete_snapshot" :: held 2.652s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-edd39a6a-cd15-4f6d-aabe-78e9274879b6" released by "delete_snapshot" :: held 2.694s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:10 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Created reservations ['2ea5a160-2e8b-49e2-adde-bfc6cd157072', 'c8614150-aea6-4a0d-ba41-9b7acd65012e', 'e0f1b157-e7bb-4777-a512-4c78722a5a09', 'e0eeb8b8-b385-4e2c-aff5-565e1cdbc64e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:35:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Delete snapshot completed successfully.
Sep 29 12:35:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8961f366-2918-4b7c-bf54-5551ccaeecff tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-5af0061b-4d6e-4af1-891b-a4c65add827e-delete_snapshot" released by "delete_snapshot" :: held 2.931s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-edd39a6a-cd15-4f6d-aabe-78e9274879b6-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:35:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-edd39a6a-cd15-4f6d-aabe-78e9274879b6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:35:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-edd39a6a-cd15-4f6d-aabe-78e9274879b6" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:35:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-edd39a6a-cd15-4f6d-aabe-78e9274879b6" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:35:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ab243e-094b-4143-90bd-37ab9798cbbc]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:11 devstack sudo[99854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6
Sep 29 12:35:11 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:12 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6" returned: 0 in 0.435s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:12 devstack sudo[99859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6
Sep 29 12:35:12 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:12 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-edd39a6a-cd15-4f6d-aabe-78e9274879b6" returned: 0 in 0.298s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-edd39a6a-cd15-4f6d-aabe-78e9274879b6" released by "delete_volume" :: held 0.837s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Created reservations ['bb4afe29-0c96-4720-9913-7fd7ede661f1', '11a35a8d-f2f4-4085-8299-e4943032ccf6', '913d3cd3-f18b-496d-858f-d943cb8104a6', '992f109b-1f91-4053-ad99-0c3bc6a70be7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:12 devstack sudo[99862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:35:12 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-a66809da-d124-47a4-8e40-2920b5869e74-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-a66809da-d124-47a4-8e40-2920b5869e74-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:35:12 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:35:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Deleted volume successfully.
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "cinder-quobyte-a66809da-d124-47a4-8e40-2920b5869e74" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-265c7460-d899-4204-a769-e427024ed36b tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-edd39a6a-cd15-4f6d-aabe-78e9274879b6-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-a66809da-d124-47a4-8e40-2920b5869e74" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:35:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9923ee-546a-4f6f-8780-cc19172a6af4]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:13 devstack sudo[99866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74
Sep 29 12:35:13 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:13 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74" returned: 0 in 0.599s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:13 devstack sudo[99871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74
Sep 29 12:35:13 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:13 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a66809da-d124-47a4-8e40-2920b5869e74" returned: 0 in 0.352s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-quobyte-a66809da-d124-47a4-8e40-2920b5869e74" released by "delete_volume" :: held 1.053s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:14 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Created reservations ['35ce906d-7e88-41a9-8738-c1203044d34f', '5e56eff3-b67b-4c9b-83ae-5ab5e453c384', 'd2ea9770-0044-4f65-ac1e-723322530b06', '469e527c-e27f-40da-9ed4-70f0432fc64c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:35:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:35:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:35:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:35:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:35:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:35:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:14 devstack sudo[99874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:35:14 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:14 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.284s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:14 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:35:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Deleted volume successfully.
Sep 29 12:35:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5cdd2a04-13c6-42b5-aca6-baacee3c8d54 tempest-VolumesSnapshotTestJSON-1714803349 None] Lock "cinder-a66809da-d124-47a4-8e40-2920b5869e74-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:24 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:INSERT=13,cinder:SELECT=30,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:35:24 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=109,cinder:INSERT=37,cinder:DELETE=12,cinder:SELECT=88 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:35:26 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:35:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Flow 'volume_create_manager' (ecd62cd4-2366-4150-8a6e-0a3e884b9a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:35:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001ff74d-7d4f-40ab-a069-b7ac20a18084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001ff74d-7d4f-40ab-a069-b7ac20a18084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1974476843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba36e4a-ce6b-411e-a40f-57c762923908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed072e8141338629a719095ca48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:35:27Z,use_quota=True,user_id='73ec0c40157d45cb84214e38ec57cfed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7040d03a-5223-423f-aec0-62bee178b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7040d03a-5223-423f-aec0-62bee178b151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9540a9c-b7ca-4dd2-bd71-5cc6699ff7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:26 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 12:35:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9540a9c-b7ca-4dd2-bd71-5cc6699ff7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ba36e4a-ce6b-411e-a40f-57c762923908', 'volume_name': 'volume-7ba36e4a-ce6b-411e-a40f-57c762923908', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701b107ad0>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c737a4a4-c559-45d7-a157-527a829045f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c737a4a4-c559-45d7-a157-527a829045f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91671726-2fa1-4b75-ab13-850b589a201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:27 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Volume 7ba36e4a-ce6b-411e-a40f-57c762923908: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ba36e4a-ce6b-411e-a40f-57c762923908', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701b107ad0>}
Sep 29 12:35:27 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Trying to clone 7ba36e4a-ce6b-411e-a40f-57c762923908 from image f8e17489-d113-49d7-ab01-94ac91f04646 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 12:35:27 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 12:35:27 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 12:35:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d07beb-8acf-4591-8684-b0967606d26a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:28 devstack sudo[100378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD
Sep 29 12:35:28 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:28 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:28 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Temporary image f8e17489-d113-49d7-ab01-94ac91f04646 is fetched for user 73ec0c40157d45cb84214e38ec57cfed. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 12:35:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b604049a-8a27-4ec3-9805-6c0d8f5ea558]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:28 devstack sudo[100384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD
Sep 29 12:35:28 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:29 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1974476843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba36e4a-ce6b-411e-a40f-57c762923908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed072e8141338629a719095ca48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:35:27Z,use_quota=True,user_id='73ec0c40157d45cb84214e38ec57cfed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Creating volume 7ba36e4a-ce6b-411e-a40f-57c762923908 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:35:29 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:29 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908 1073741824
Sep 29 12:35:29 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:29 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908 1073741824" returned: 0 in 0.700s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:29 devstack sudo[100398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908
Sep 29 12:35:29 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:30 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908" returned: 0 in 0.391s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:35:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:35:30 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Attempting download of f8e17489-d113-49d7-ab01-94ac91f04646 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}])) to volume 7ba36e4a-ce6b-411e-a40f-57c762923908. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 12:35:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[83435084-7eda-4b8c-87f9-2c6d18816c15]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_o6_6w99z {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:30 devstack sudo[100401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_o6_6w99z
Sep 29 12:35:30 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:31 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_o6_6w99z" returned: 0 in 0.706s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_o6_6w99z {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:31 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_o6_6w99z
Sep 29 12:35:31 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:31 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_o6_6w99z" returned: 1 in 0.409s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_o6_6w99z' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:35:31 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b876128f-7787-4427-beab-0b9e1e4eae38]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:31 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD
Sep 29 12:35:31 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:32 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:32 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] f8e17489-d113-49d7-ab01-94ac91f04646 was qcow2, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 12:35:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:32 devstack sudo[100416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908
Sep 29 12:35:32 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:35 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908" returned: 0 in 3.131s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:35 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646_w820eb3edevstack@QuobyteHD, size 112.00 MB, duration 3.14 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:35:35 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Converted 112.00 MB image at 35.72 MB/s
Sep 29 12:35:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:35 devstack sudo[100453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908 1G
Sep 29 12:35:35 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:35 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908 1G" returned: 0 in 0.481s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:35 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Downloaded image f8e17489-d113-49d7-ab01-94ac91f04646 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}])) to volume 7ba36e4a-ce6b-411e-a40f-57c762923908 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 12:35:35 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Temporary image f8e17489-d113-49d7-ab01-94ac91f04646 for user 73ec0c40157d45cb84214e38ec57cfed is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 12:35:35 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Marking volume 7ba36e4a-ce6b-411e-a40f-57c762923908 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 12:35:35 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Copying metadata from image f8e17489-d113-49d7-ab01-94ac91f04646 to 7ba36e4a-ce6b-411e-a40f-57c762923908. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 12:35:35 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Creating volume glance metadata for volume 7ba36e4a-ce6b-411e-a40f-57c762923908 backed by image f8e17489-d113-49d7-ab01-94ac91f04646 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 12:35:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91671726-2fa1-4b75-ab13-850b589a201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ba36e4a-ce6b-411e-a40f-57c762923908', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701b107ad0>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3d1a75-cd91-4633-a94e-3bf298235956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Volume volume-7ba36e4a-ce6b-411e-a40f-57c762923908 (7ba36e4a-ce6b-411e-a40f-57c762923908): created successfully
Sep 29 12:35:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3d1a75-cd91-4633-a94e-3bf298235956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Flow 'volume_create_manager' (ecd62cd4-2366-4150-8a6e-0a3e884b9a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:35:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-803b6d05-10b8-4624-b7fa-34e288d5ba66 tempest-VolumesImageMetadata-471359187 None] Created volume successfully.
Sep 29 12:35:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Acquiring lock "cinder-7ba36e4a-ce6b-411e-a40f-57c762923908-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:35:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Lock "cinder-7ba36e4a-ce6b-411e-a40f-57c762923908-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:35:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Acquiring lock "cinder-quobyte-7ba36e4a-ce6b-411e-a40f-57c762923908" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:35:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Lock "cinder-quobyte-7ba36e4a-ce6b-411e-a40f-57c762923908" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:35:37 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cded5325-6819-472b-9936-633937f7af62]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:38 devstack sudo[100466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908
Sep 29 12:35:38 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Flow 'volume_create_manager' (08008d19-04a7-4c90-a0d3-7e682aee552b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911172ee-fd09-439f-ba16-d77e8ca5848d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911172ee-fd09-439f-ba16-d77e8ca5848d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-723425996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e587048-8be0-401c-b48e-6a321f548a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a0f08277ac445394da70c74fbd364f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:35:38Z,use_quota=True,user_id='d6d024b90e46401b84c54aede094c85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f836701c-2235-496d-9bc8-26bf6e9168a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f836701c-2235-496d-9bc8-26bf6e9168a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0b9c6b-6c49-4348-9b29-8b118994a3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0b9c6b-6c49-4348-9b29-8b118994a3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e587048-8be0-401c-b48e-6a321f548a72', 'volume_name': 'volume-9e587048-8be0-401c-b48e-6a321f548a72', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21faca96-9c43-4e57-8449-4354217f4b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21faca96-9c43-4e57-8449-4354217f4b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082d226a-8a02-443d-8816-9899a756d191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:38 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Volume 9e587048-8be0-401c-b48e-6a321f548a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e587048-8be0-401c-b48e-6a321f548a72', 'volume_size': 1}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-723425996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e587048-8be0-401c-b48e-6a321f548a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a0f08277ac445394da70c74fbd364f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:35:38Z,use_quota=True,user_id='d6d024b90e46401b84c54aede094c85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Creating volume 9e587048-8be0-401c-b48e-6a321f548a72 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:35:38 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:38 devstack sudo[100468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72 1073741824
Sep 29 12:35:38 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:38 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908" returned: 0 in 0.460s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:38 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908
Sep 29 12:35:38 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:38 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7ba36e4a-ce6b-411e-a40f-57c762923908" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Lock "cinder-quobyte-7ba36e4a-ce6b-411e-a40f-57c762923908" released by "delete_volume" :: held 0.893s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:38 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72 1073741824" returned: 0 in 0.592s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Created reservations ['29380d1f-1342-4407-bc90-5187364a30e9', 'a787dcf5-0f8b-499c-a7fb-c4ad3fa6db8c', '75e4d5d9-3efc-4e57-b5a5-d8346a7f1387', 'c1c4048d-4b04-4a33-89c0-ce8f039196dc'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:35:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:38 devstack sudo[100480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72
Sep 29 12:35:38 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:39 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:35:39 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:39 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72" returned: 0 in 0.387s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082d226a-8a02-443d-8816-9899a756d191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e587048-8be0-401c-b48e-6a321f548a72', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03aa9bcb-b4ad-4841-871b-b96560c3aba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:35:39 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Volume volume-9e587048-8be0-401c-b48e-6a321f548a72 (9e587048-8be0-401c-b48e-6a321f548a72): created successfully
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03aa9bcb-b4ad-4841-871b-b96560c3aba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Flow 'volume_create_manager' (08008d19-04a7-4c90-a0d3-7e682aee552b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:35:39 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.320s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:35:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-35f616ba-46cb-4d9c-aa4f-7e27f3023837 tempest-TestImageHashVerification-1814327258 None] Created volume successfully.
Sep 29 12:35:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Deleted volume successfully.
Sep 29 12:35:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b38d9b17-2a0f-4e23-b1b1-ccb39237dac9 tempest-VolumesImageMetadata-471359187 None] Lock "cinder-7ba36e4a-ce6b-411e-a40f-57c762923908-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:35:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:35:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:35:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[455c957f-5cbd-4d38-9ae7-1d2839b156d3]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:41 devstack sudo[100486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72
Sep 29 12:35:41 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:42 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72" returned: 0 in 0.534s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde4014b-d1bf-458a-a74f-f33a7bb5ec3c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:42 devstack sudo[100491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72
Sep 29 12:35:42 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:42 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72" returned: 0 in 0.576s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72 /opt/stack/data/cinder/conversion/9e587048-8be0-401c-b48e-6a321f548a72.temp_image.ea574134-5f78-4a0e-864e-97b0639c96can2xz8ouo.img {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:42 devstack sudo[100496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72 /opt/stack/data/cinder/conversion/9e587048-8be0-401c-b48e-6a321f548a72.temp_image.ea574134-5f78-4a0e-864e-97b0639c96can2xz8ouo.img
Sep 29 12:35:42 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:49 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=21,cinder:SELECT=13,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:35:51 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=21,cinder:INSERT=10,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:35:52 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72 /opt/stack/data/cinder/conversion/9e587048-8be0-401c-b48e-6a321f548a72.temp_image.ea574134-5f78-4a0e-864e-97b0639c96can2xz8ouo.img" returned: 0 in 9.731s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:52 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b90984-b85a-44a5-b051-4184ab221a5d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:35:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:35:52 devstack sudo[100511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72
Sep 29 12:35:52 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:35:53 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root
Sep 29 12:35:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72" returned: 0 in 0.621s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:35:53 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72, size 1024.00 MB, duration 9.73 sec, destination /opt/stack/data/cinder/conversion/9e587048-8be0-401c-b48e-6a321f548a72.temp_image.ea574134-5f78-4a0e-864e-97b0639c96can2xz8ouo.img {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:35:53 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] Converted 1024.00 MB image at 105.22 MB/s
Sep 29 12:35:53 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] ea574134-5f78-4a0e-864e-97b0639c96ca was raw, no need to convert to raw {{(pid=86369) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 29 12:36:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-fed6e3e3-7901-4a85-9f82-d9d865812e3b req-8cbdccd8-df2f-499b-a2a8-8a705ba5250d tempest-TestShelveInstance-1211941693 None] Terminate volume connection completed successfully.
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-fed6e3e3-7901-4a85-9f82-d9d865812e3b req-8cbdccd8-df2f-499b-a2a8-8a705ba5250d tempest-TestShelveInstance-1211941693 None] Deleting attachment 5620de37-36c1-457f-8a7c-a10a8f1b7d5a. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Flow 'volume_create_manager' (fd6f5326-1d04-4d2a-99ed-1e5c16f5b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e789e15-7a19-4a9d-a2e8-6b9a5e1204fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e789e15-7a19-4a9d-a2e8-6b9a5e1204fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1178554520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3edcbeb-7bcb-4ce6-8355-c893bbbaa208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccdf4581867437b99afd782c80c1b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:02Z,use_quota=True,user_id='686b31e80ab342b2a0e42f63268c1f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a856abb4-1e08-459c-bdda-b9daeef91346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a856abb4-1e08-459c-bdda-b9daeef91346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9586b1d7-0bd5-433d-a571-e7e44222ee5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9586b1d7-0bd5-433d-a571-e7e44222ee5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3edcbeb-7bcb-4ce6-8355-c893bbbaa208', 'volume_name': 'volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2a327e-7843-40a1-a0ed-ff3d8a5cd62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2a327e-7843-40a1-a0ed-ff3d8a5cd62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a03d780-b31e-47d0-b105-6047e61162e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:02 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Volume b3edcbeb-7bcb-4ce6-8355-c893bbbaa208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208', 'volume_size': 1}
Sep 29 12:36:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-04fac8ea-cee3-474e-a08d-4ba8e04f753e req-8bf70531-1cc7-4865-8120-e23f26cebd7a tempest-TestShelveInstance-1211941693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:36:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:36:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:36:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:07 devstack sudo[100616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:36:07 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:08 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.330s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:36:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:36:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:36:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Flow 'volume_create_manager' (69798fb0-ce9d-44b0-af29-dc2818a32e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e28ce1d-5816-4d4d-8b82-6d0711e74e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e28ce1d-5816-4d4d-8b82-6d0711e74e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-967213223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976c0cf3-84ff-4e31-aabe-59c263ee5040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de856b8c49b7474ea08a3d2f289622a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:18Z,use_quota=True,user_id='3f4293f9dc0a4122ad5a83adf8fc9c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(003af336-8822-44b3-b677-e6be94ef16ec),volume_type_id=003af336-8822-44b3-b677-e6be94ef16ec)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045e0964-3204-48ab-992c-1bf6ebf1cfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045e0964-3204-48ab-992c-1bf6ebf1cfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81d23a8-34d4-4285-93c1-ec608aa4b67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81d23a8-34d4-4285-93c1-ec608aa4b67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976c0cf3-84ff-4e31-aabe-59c263ee5040', 'volume_name': 'volume-976c0cf3-84ff-4e31-aabe-59c263ee5040', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b2f563-3f91-4fc3-81b5-2e6f64aca5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b2f563-3f91-4fc3-81b5-2e6f64aca5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9bda3b-3c59-44bd-b178-f2f611aebf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Volume 976c0cf3-84ff-4e31-aabe-59c263ee5040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976c0cf3-84ff-4e31-aabe-59c263ee5040', 'volume_size': 1}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:18 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Flow 'volume_create_manager' (9a3ccf30-5a57-4236-a970-d9a615c40a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca97861-9db0-4753-b0dc-3896de0e2bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca97861-9db0-4753-b0dc-3896de0e2bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-237259010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c1ba54-9425-4cdb-ab45-00c27dcb7a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de856b8c49b7474ea08a3d2f289622a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:19Z,use_quota=True,user_id='3f4293f9dc0a4122ad5a83adf8fc9c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cff3cbe-4723-425a-921b-d15516a23798),volume_type_id=5cff3cbe-4723-425a-921b-d15516a23798)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26f3e44-a521-414c-befa-6cd9cb6278cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26f3e44-a521-414c-befa-6cd9cb6278cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b857c325-5b85-426a-b918-71919f44c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b857c325-5b85-426a-b918-71919f44c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c1ba54-9425-4cdb-ab45-00c27dcb7a66', 'volume_name': 'volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983ece7d-0493-499b-8718-c03208bef359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983ece7d-0493-499b-8718-c03208bef359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f176d6e-cca9-4838-b1e2-94923301bd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Volume 56c1ba54-9425-4cdb-ab45-00c27dcb7a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66', 'volume_size': 1}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.514s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] Uploaded volume to glance image-id: ea574134-5f78-4a0e-864e-97b0639c96ca. {{(pid=86369) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.927s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1178554520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3edcbeb-7bcb-4ce6-8355-c893bbbaa208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fccdf4581867437b99afd782c80c1b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:02Z,use_quota=True,user_id='686b31e80ab342b2a0e42f63268c1f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Creating volume b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:36:19 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4149b62a-401f-442a-858c-ea145350ae1a tempest-TestImageHashVerification-1814327258 None] Copy volume to image completed successfully.
Sep 29 12:36:19 devstack sudo[100622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 1073741824
Sep 29 12:36:19 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Flow 'volume_create_manager' (75906f76-3c24-455e-8950-164b2db2865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee3cff1-25fc-497e-a016-d985ae0bba80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee3cff1-25fc-497e-a016-d985ae0bba80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-822277707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e05c66-f915-44fc-930a-1068e70accde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de856b8c49b7474ea08a3d2f289622a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:20Z,use_quota=True,user_id='3f4293f9dc0a4122ad5a83adf8fc9c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(678eb649-abba-4b98-9590-9f60b6289f14),volume_type_id=678eb649-abba-4b98-9590-9f60b6289f14)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d70b5a-9f82-43f1-8e03-2fcc41c83898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d70b5a-9f82-43f1-8e03-2fcc41c83898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67c3ae2-3042-4ce9-b19b-fb66571d7c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 12:36:19 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 1073741824" returned: 0 in 0.649s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:19 devstack sudo[100628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208
Sep 29 12:36:19 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67c3ae2-3042-4ce9-b19b-fb66571d7c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a3e05c66-f915-44fc-930a-1068e70accde', 'volume_name': 'volume-a3e05c66-f915-44fc-930a-1068e70accde', 'volume_size': 1, 'image_id': '33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--487088648', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de856b8c49b7474ea08a3d2f289622a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'created_at': datetime.datetime(2026, 9, 29, 10, 36, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 36, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33bc31fe-49d5-4693-92c3-09f53bbda6c3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701b4cd790>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb04ba5-ccfa-4d86-8f69-e20576ef3bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb04ba5-ccfa-4d86-8f69-e20576ef3bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1b8c59-1fa6-43b4-8b66-f4bb91f2953f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Volume a3e05c66-f915-44fc-930a-1068e70accde: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a3e05c66-f915-44fc-930a-1068e70accde', 'volume_size': 1, 'image_id': '33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--487088648', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de856b8c49b7474ea08a3d2f289622a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'created_at': datetime.datetime(2026, 9, 29, 10, 36, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 36, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33bc31fe-49d5-4693-92c3-09f53bbda6c3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701b4cd790>}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Trying to clone a3e05c66-f915-44fc-930a-1068e70accde from image 33bc31fe-49d5-4693-92c3-09f53bbda6c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 12:36:20 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" returned: 0 in 0.282s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-04fac8ea-cee3-474e-a08d-4ba8e04f753e req-8bf70531-1cc7-4865-8120-e23f26cebd7a tempest-TestShelveInstance-1211941693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.565s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a03d780-b31e-47d0-b105-6047e61162e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd49d95-5ad9-4971-aba3-c22bba3b773e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-04fac8ea-cee3-474e-a08d-4ba8e04f753e req-8bf70531-1cc7-4865-8120-e23f26cebd7a tempest-TestShelveInstance-1211941693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.806s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-967213223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976c0cf3-84ff-4e31-aabe-59c263ee5040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de856b8c49b7474ea08a3d2f289622a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:18Z,use_quota=True,user_id='3f4293f9dc0a4122ad5a83adf8fc9c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(003af336-8822-44b3-b677-e6be94ef16ec),volume_type_id=003af336-8822-44b3-b677-e6be94ef16ec)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Creating volume 976c0cf3-84ff-4e31-aabe-59c263ee5040 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:36:20 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-976c0cf3-84ff-4e31-aabe-59c263ee5040 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Acquiring lock "cinder-9e587048-8be0-401c-b48e-6a321f548a72-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:36:20 devstack sudo[100631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-976c0cf3-84ff-4e31-aabe-59c263ee5040 1073741824
Sep 29 12:36:20 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Volume volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 (b3edcbeb-7bcb-4ce6-8355-c893bbbaa208): created successfully
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd49d95-5ad9-4971-aba3-c22bba3b773e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Flow 'volume_create_manager' (fd6f5326-1d04-4d2a-99ed-1e5c16f5b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-12b2ef55-630d-4ac1-98db-f9629a878900 tempest-VolumesActionsTest-1221306815 None] Created volume successfully.
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Lock "cinder-9e587048-8be0-401c-b48e-6a321f548a72-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-04fac8ea-cee3-474e-a08d-4ba8e04f753e req-8bf70531-1cc7-4865-8120-e23f26cebd7a tempest-TestShelveInstance-1211941693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ade2c762-f631-4156-b6dc-391f2282db04', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Acquiring lock "cinder-quobyte-9e587048-8be0-401c-b48e-6a321f548a72" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Lock "cinder-quobyte-9e587048-8be0-401c-b48e-6a321f548a72" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[def32025-4db7-4613-935b-0fdab3461399]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:36:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-04fac8ea-cee3-474e-a08d-4ba8e04f753e req-8bf70531-1cc7-4865-8120-e23f26cebd7a tempest-TestShelveInstance-1211941693 None] attachment_update completed successfully.
Sep 29 12:36:20 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72
Sep 29 12:36:20 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:21 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-976c0cf3-84ff-4e31-aabe-59c263ee5040 1073741824" returned: 0 in 0.755s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-976c0cf3-84ff-4e31-aabe-59c263ee5040 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:21 devstack sudo[100642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-976c0cf3-84ff-4e31-aabe-59c263ee5040
Sep 29 12:36:21 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:21 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72" returned: 0 in 0.699s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:21 devstack sudo[100644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72
Sep 29 12:36:21 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:21 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-976c0cf3-84ff-4e31-aabe-59c263ee5040" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.447s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-237259010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c1ba54-9425-4cdb-ab45-00c27dcb7a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de856b8c49b7474ea08a3d2f289622a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:19Z,use_quota=True,user_id='3f4293f9dc0a4122ad5a83adf8fc9c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cff3cbe-4723-425a-921b-d15516a23798),volume_type_id=5cff3cbe-4723-425a-921b-d15516a23798)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Creating volume 56c1ba54-9425-4cdb-ab45-00c27dcb7a66 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:36:21 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:21 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9e587048-8be0-401c-b48e-6a321f548a72" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:21 devstack sudo[100648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66 1073741824
Sep 29 12:36:21 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Lock "cinder-quobyte-9e587048-8be0-401c-b48e-6a321f548a72" released by "delete_volume" :: held 1.140s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9bda3b-3c59-44bd-b178-f2f611aebf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976c0cf3-84ff-4e31-aabe-59c263ee5040', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545111f1-a6d7-46fb-93d5-22da5f519df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Volume volume-976c0cf3-84ff-4e31-aabe-59c263ee5040 (976c0cf3-84ff-4e31-aabe-59c263ee5040): created successfully
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545111f1-a6d7-46fb-93d5-22da5f519df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Flow 'volume_create_manager' (69798fb0-ce9d-44b0-af29-dc2818a32e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2b5c928a-8616-44f6-b8a3-56533179720c tempest-TestInstancesWithCinderVolumes-624594648 None] Created volume successfully.
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Created reservations ['c7538f83-2313-438a-86ff-6186c74c6474', 'f231c92a-256b-4b3d-8f7a-d4c58b51a9ea', 'b0f3af8f-f7e8-4601-bf8b-df02dd4e8c1f', '2ae151ec-1dfc-4366-b7dd-b50345982840'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:22 devstack sudo[100656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:36:22 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:22 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.307s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:22 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:36:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Deleted volume successfully.
Sep 29 12:36:22 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66 1073741824" returned: 0 in 0.753s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-248771b7-9a84-4fd0-8f56-1d7d28341037 tempest-TestImageHashVerification-1814327258 None] Lock "cinder-9e587048-8be0-401c-b48e-6a321f548a72-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:36:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:22 devstack sudo[100660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66
Sep 29 12:36:22 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:22 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66" returned: 0 in 0.443s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:36:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f176d6e-cca9-4838-b1e2-94923301bd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2478766e-67bc-432f-90b6-0a7f8b1ff123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:22 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Volume volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66 (56c1ba54-9425-4cdb-ab45-00c27dcb7a66): created successfully
Sep 29 12:36:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2478766e-67bc-432f-90b6-0a7f8b1ff123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Flow 'volume_create_manager' (9a3ccf30-5a57-4236-a970-d9a615c40a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f85b0980-44dd-4b5b-ae13-5121a803bff1 tempest-TestInstancesWithCinderVolumes-624594648 None] Created volume successfully.
Sep 29 12:36:25 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD, size 20.69 MB, duration 5.67 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 12:36:25 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Image download 20.69 MB at 3.65 MB/s
Sep 29 12:36:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c1a5d6-3e9f-4ef9-9962-6ebb58a94b92]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:36:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:26 devstack sudo[100685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD
Sep 29 12:36:26 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:26 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Temporary image 33bc31fe-49d5-4693-92c3-09f53bbda6c3 is fetched for user 3f4293f9dc0a4122ad5a83adf8fc9c0a. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e6930d-6ad0-4c0b-b0a1-6c41860f774d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:26 devstack sudo[100691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD
Sep 29 12:36:26 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:26 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-822277707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e05c66-f915-44fc-930a-1068e70accde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de856b8c49b7474ea08a3d2f289622a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:20Z,use_quota=True,user_id='3f4293f9dc0a4122ad5a83adf8fc9c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(678eb649-abba-4b98-9590-9f60b6289f14),volume_type_id=678eb649-abba-4b98-9590-9f60b6289f14)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Creating volume a3e05c66-f915-44fc-930a-1068e70accde {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:36:26 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:36:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:26 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde 1073741824
Sep 29 12:36:26 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde 1073741824" returned: 0 in 0.920s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:27 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:27 devstack sudo[101148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde
Sep 29 12:36:27 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:28 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde" returned: 0 in 0.422s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:36:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:28 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Attempting download of 33bc31fe-49d5-4693-92c3-09f53bbda6c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'metadata': {}}])) to volume a3e05c66-f915-44fc-930a-1068e70accde. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 12:36:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da527ff-e07a-43ff-bb60-8a952e21d574]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:36:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33bc31fe-49d5-4693-92c3-09f53bbda6c3_devdbuid {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:28 devstack sudo[101174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33bc31fe-49d5-4693-92c3-09f53bbda6c3_devdbuid
Sep 29 12:36:28 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:29 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33bc31fe-49d5-4693-92c3-09f53bbda6c3_devdbuid" returned: 0 in 0.610s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33bc31fe-49d5-4693-92c3-09f53bbda6c3_devdbuid {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:29 devstack sudo[101206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33bc31fe-49d5-4693-92c3-09f53bbda6c3_devdbuid
Sep 29 12:36:29 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:29 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33bc31fe-49d5-4693-92c3-09f53bbda6c3_devdbuid" returned: 1 in 0.709s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33bc31fe-49d5-4693-92c3-09f53bbda6c3_devdbuid' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:36:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0799dea6-d43a-4d13-b4ee-7597623277a0]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:36:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:29 devstack sudo[101236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD
Sep 29 12:36:29 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:30 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:30 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] 33bc31fe-49d5-4693-92c3-09f53bbda6c3 was qcow2, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 12:36:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:30 devstack sudo[101255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde
Sep 29 12:36:30 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:33 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde" returned: 0 in 3.460s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:33 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33bc31fe-49d5-4693-92c3-09f53bbda6c3_4hbbv0_cdevstack@QuobyteHD, size 112.00 MB, duration 3.46 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:36:33 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Converted 112.00 MB image at 32.35 MB/s
Sep 29 12:36:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:33 devstack sudo[101296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde 1G
Sep 29 12:36:33 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:34 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde 1G" returned: 0 in 0.584s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:34 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Downloaded image 33bc31fe-49d5-4693-92c3-09f53bbda6c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'metadata': {}}])) to volume a3e05c66-f915-44fc-930a-1068e70accde successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 12:36:34 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Temporary image 33bc31fe-49d5-4693-92c3-09f53bbda6c3 for user 3f4293f9dc0a4122ad5a83adf8fc9c0a is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 12:36:34 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Marking volume a3e05c66-f915-44fc-930a-1068e70accde as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 12:36:34 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Copying metadata from image 33bc31fe-49d5-4693-92c3-09f53bbda6c3 to a3e05c66-f915-44fc-930a-1068e70accde. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 12:36:34 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Creating volume glance metadata for volume a3e05c66-f915-44fc-930a-1068e70accde backed by image 33bc31fe-49d5-4693-92c3-09f53bbda6c3 with: {'image_id': '33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'image_name': 'tempest-scenario-img--487088648', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 12:36:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1b8c59-1fa6-43b4-8b66-f4bb91f2953f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e05c66-f915-44fc-930a-1068e70accde', 'volume_size': 1, 'image_id': '33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--487088648', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de856b8c49b7474ea08a3d2f289622a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33bc31fe-49d5-4693-92c3-09f53bbda6c3', 'created_at': datetime.datetime(2026, 9, 29, 10, 36, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 36, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33bc31fe-49d5-4693-92c3-09f53bbda6c3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701b4cd790>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d7cb3c-dce1-4a91-a3a8-8aedf09f2144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:34 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Volume volume-a3e05c66-f915-44fc-930a-1068e70accde (a3e05c66-f915-44fc-930a-1068e70accde): created successfully
Sep 29 12:36:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d7cb3c-dce1-4a91-a3a8-8aedf09f2144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Flow 'volume_create_manager' (75906f76-3c24-455e-8950-164b2db2865d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-62dee843-b9fe-46cd-ae0e-4bf1a6c6fcb1 tempest-TestInstancesWithCinderVolumes-624594648 None] Created volume successfully.
Sep 29 12:36:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d9c80648-1e6a-4d81-b315-1488c0bc6d03 tempest-VolumesActionsTest-1221306815 None] Acquiring lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" by "attach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:36:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d9c80648-1e6a-4d81-b315-1488c0bc6d03 tempest-VolumesActionsTest-1221306815 None] Lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" acquired by "attach_volume" :: waited 0.038s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:36:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d9c80648-1e6a-4d81-b315-1488c0bc6d03 tempest-VolumesActionsTest-1221306815 None] Attaching volume b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 to instance e5b56160-ea03-47f6-b5a9-71e35d064f7f at mountpoint /dev/vdb on host None.
Sep 29 12:36:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d9c80648-1e6a-4d81-b315-1488c0bc6d03 tempest-VolumesActionsTest-1221306815 None] Attach volume completed successfully.
Sep 29 12:36:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d9c80648-1e6a-4d81-b315-1488c0bc6d03 tempest-VolumesActionsTest-1221306815 None] Lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" released by "attach_volume" :: held 0.167s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:36:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2d37f757-ebf4-48e4-bb66-e76f5a91914a tempest-VolumesActionsTest-1221306815 None] Acquiring lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208-detach_volume" by "detach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:36:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2d37f757-ebf4-48e4-bb66-e76f5a91914a tempest-VolumesActionsTest-1221306815 None] Lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:36:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2d37f757-ebf4-48e4-bb66-e76f5a91914a tempest-VolumesActionsTest-1221306815 None] Detaching volume b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 from instance e5b56160-ea03-47f6-b5a9-71e35d064f7f.
Sep 29 12:36:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2d37f757-ebf4-48e4-bb66-e76f5a91914a tempest-VolumesActionsTest-1221306815 None] Detach volume completed successfully.
Sep 29 12:36:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2d37f757-ebf4-48e4-bb66-e76f5a91914a tempest-VolumesActionsTest-1221306815 None] Lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:36:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-0ae77099-8a79-4f90-b07c-be47436b5557 req-8d3656bf-bb39-4487-9381-cd99e6ddd1cc tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-0ae77099-8a79-4f90-b07c-be47436b5557 req-8d3656bf-bb39-4487-9381-cd99e6ddd1cc tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-0ae77099-8a79-4f90-b07c-be47436b5557 req-8d3656bf-bb39-4487-9381-cd99e6ddd1cc tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0ae77099-8a79-4f90-b07c-be47436b5557 req-8d3656bf-bb39-4487-9381-cd99e6ddd1cc tempest-TestInstancesWithCinderVolumes-624594648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-a3e05c66-f915-44fc-930a-1068e70accde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ade4a059-3496-422b-a6f7-37ff54694ba4', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:36:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-0ae77099-8a79-4f90-b07c-be47436b5557 req-8d3656bf-bb39-4487-9381-cd99e6ddd1cc tempest-TestInstancesWithCinderVolumes-624594648 None] attachment_update completed successfully.
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Flow 'volume_create_manager' (c907b21d-dfd9-412c-9c73-c71363c85700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd73ed36-d079-4078-acba-909bfbf7f4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd73ed36-d079-4078-acba-909bfbf7f4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-712609912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9583f0d6aca946d39bd2f7a952d09595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:47Z,use_quota=True,user_id='2e761b9399cd47c69a32c99b0c2c2f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd32dd04-51a6-4d7a-a8c5-29bedd5db69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd32dd04-51a6-4d7a-a8c5-29bedd5db69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c9e9f6-ca17-4949-a33b-18014fc2882e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c9e9f6-ca17-4949-a33b-18014fc2882e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d', 'volume_name': 'volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83f49c6-09f6-480e-9850-bdb55c9e75e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83f49c6-09f6-480e-9850-bdb55c9e75e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f1e57e-12ca-4040-9d3a-fa401fe25603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:46 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d', 'volume_size': 1}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-712609912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9583f0d6aca946d39bd2f7a952d09595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:47Z,use_quota=True,user_id='2e761b9399cd47c69a32c99b0c2c2f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Creating volume a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:36:46 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:36:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:47 devstack sudo[101459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d 1073741824
Sep 29 12:36:47 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:47 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d 1073741824" returned: 0 in 0.731s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:47 devstack sudo[101475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d
Sep 29 12:36:47 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:48 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d" returned: 0 in 0.382s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:36:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f1e57e-12ca-4040-9d3a-fa401fe25603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28005d9c-8fa6-4a34-88a7-812899e3a40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:48 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d (a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d): created successfully
Sep 29 12:36:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28005d9c-8fa6-4a34-88a7-812899e3a40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Flow 'volume_create_manager' (c907b21d-dfd9-412c-9c73-c71363c85700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a9b0e92c-ec96-459c-8272-d84155cd67c9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Created volume successfully.
Sep 29 12:36:49 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=40,cinder:UPDATE=32,cinder:INSERT=11 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:36:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] Creating offline snapshot 93f4757d-e7af-4431-8f3a-f01113e74be6 of volume a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:36:49 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf77e3c-170b-4501-97a9-2a187e75e6fd]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:36:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:49 devstack sudo[101482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d
Sep 29 12:36:49 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:50 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d" returned: 0 in 0.785s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:50 devstack sudo[101502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6 1G
Sep 29 12:36:50 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:51 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6 1G" returned: 0 in 1.068s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:51 devstack sudo[101538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6
Sep 29 12:36:51 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:52 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6" returned: 0 in 0.844s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:52 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6 is being set with open permissions: ugo+rw
Sep 29 12:36:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:52 devstack sudo[101565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6
Sep 29 12:36:52 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:52 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6" returned: 0 in 0.671s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:53 devstack sudo[101583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.info
Sep 29 12:36:53 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:53 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.info" returned: 0 in 0.496s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:53 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.info is being set with open permissions: ugo+rw
Sep 29 12:36:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:53 devstack sudo[101602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.info
Sep 29 12:36:53 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:53 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.info" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.529s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ae37b5e5-e583-46ad-8fae-82d9967dff82 tempest-CreateVolumesFromSnapshotTest-328092905 None] Create snapshot completed successfully
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c4684b45-0ba4-4732-9ebf-fddea18e697a tempest-VolumesActionsTest-1221306815 None] Acquiring lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" by "attach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c4684b45-0ba4-4732-9ebf-fddea18e697a tempest-VolumesActionsTest-1221306815 None] Lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" acquired by "attach_volume" :: waited 0.058s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Flow 'volume_create_manager' (35d52282-ccac-42cc-974d-255d7f906717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128e9a1b-e3bc-4dac-8263-55b72e5cf605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c4684b45-0ba4-4732-9ebf-fddea18e697a tempest-VolumesActionsTest-1221306815 None] Attaching volume b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 to instance 794220b1-4f18-474e-bcbd-8249df28e9e8 at mountpoint /dev/vdb on host None.
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128e9a1b-e3bc-4dac-8263-55b72e5cf605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-730873122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d344695-3f56-4feb-bfa4-ec4c0756accd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9583f0d6aca946d39bd2f7a952d09595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:56Z,use_quota=True,user_id='2e761b9399cd47c69a32c99b0c2c2f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454eec4b-842f-44a1-a600-8736bf48b459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454eec4b-842f-44a1-a600-8736bf48b459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28ccaa0-6bc5-423c-bf4f-1134b5d0a503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28ccaa0-6bc5-423c-bf4f-1134b5d0a503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d344695-3f56-4feb-bfa4-ec4c0756accd', 'volume_name': 'volume-9d344695-3f56-4feb-bfa4-ec4c0756accd', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3cc3b0-84b0-4af7-9740-edf43da71f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3cc3b0-84b0-4af7-9740-edf43da71f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e35504-d78c-406a-b37c-6c49edea29ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:56 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume 9d344695-3f56-4feb-bfa4-ec4c0756accd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d344695-3f56-4feb-bfa4-ec4c0756accd', 'volume_size': 1}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-730873122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d344695-3f56-4feb-bfa4-ec4c0756accd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9583f0d6aca946d39bd2f7a952d09595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:56Z,use_quota=True,user_id='2e761b9399cd47c69a32c99b0c2c2f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Creating volume 9d344695-3f56-4feb-bfa4-ec4c0756accd {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:36:56 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9d344695-3f56-4feb-bfa4-ec4c0756accd 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:56 devstack sudo[101651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9d344695-3f56-4feb-bfa4-ec4c0756accd 1073741824
Sep 29 12:36:56 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c4684b45-0ba4-4732-9ebf-fddea18e697a tempest-VolumesActionsTest-1221306815 None] Attach volume completed successfully.
Sep 29 12:36:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c4684b45-0ba4-4732-9ebf-fddea18e697a tempest-VolumesActionsTest-1221306815 None] Lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" released by "attach_volume" :: held 0.486s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:36:57 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:36:57 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Flow 'volume_create_manager' (9791a56a-563b-409b-be02-4963b0e80fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9a6a28-a2a7-4e95-8e3c-980f6e95364e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9d344695-3f56-4feb-bfa4-ec4c0756accd 1073741824" returned: 0 in 1.293s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9a6a28-a2a7-4e95-8e3c-980f6e95364e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1303240656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37184080-848e-40ec-bc5f-4a019bbd12f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9583f0d6aca946d39bd2f7a952d09595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:57Z,use_quota=True,user_id='2e761b9399cd47c69a32c99b0c2c2f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293f80db-973c-4286-ba8e-66f2de759121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293f80db-973c-4286-ba8e-66f2de759121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6a7d03-2099-4023-8b0c-778f86910dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6a7d03-2099-4023-8b0c-778f86910dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37184080-848e-40ec-bc5f-4a019bbd12f4', 'volume_name': 'volume-37184080-848e-40ec-bc5f-4a019bbd12f4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d390607e-51c0-4d11-b8da-6eb29e518f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d390607e-51c0-4d11-b8da-6eb29e518f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d7dbf5-8a3e-4d15-b480-a45f767c6e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:58 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume 37184080-848e-40ec-bc5f-4a019bbd12f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37184080-848e-40ec-bc5f-4a019bbd12f4', 'volume_size': 1}
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-917e5426-9359-444c-96b7-f247bb7ae2fb tempest-VolumesActionsTest-1221306815 None] Acquiring lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208-detach_volume" by "detach_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-917e5426-9359-444c-96b7-f247bb7ae2fb tempest-VolumesActionsTest-1221306815 None] Lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:36:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-917e5426-9359-444c-96b7-f247bb7ae2fb tempest-VolumesActionsTest-1221306815 None] Detaching volume b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 from instance 794220b1-4f18-474e-bcbd-8249df28e9e8.
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9d344695-3f56-4feb-bfa4-ec4c0756accd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:58 devstack sudo[101657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9d344695-3f56-4feb-bfa4-ec4c0756accd
Sep 29 12:36:58 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-917e5426-9359-444c-96b7-f247bb7ae2fb tempest-VolumesActionsTest-1221306815 None] Detach volume completed successfully.
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-917e5426-9359-444c-96b7-f247bb7ae2fb tempest-VolumesActionsTest-1221306815 None] Lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208-detach_volume" released by "detach_volume" :: held 0.344s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Flow 'volume_create_manager' (fc7441b7-6960-48fb-af84-898fd4278036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0128506b-7aa4-4a77-bec6-487913eb602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0128506b-7aa4-4a77-bec6-487913eb602f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647200989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed858347-99bf-4197-9825-8116e2344752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9583f0d6aca946d39bd2f7a952d09595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:58Z,use_quota=True,user_id='2e761b9399cd47c69a32c99b0c2c2f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd193333-1018-4840-83cb-69f419c1326d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd193333-1018-4840-83cb-69f419c1326d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afc8d3a-8062-4efe-b61b-0b9fbd915ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afc8d3a-8062-4efe-b61b-0b9fbd915ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed858347-99bf-4197-9825-8116e2344752', 'volume_name': 'volume-ed858347-99bf-4197-9825-8116e2344752', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e418a2-03ea-4703-8b12-2c6a8bf7e4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e418a2-03ea-4703-8b12-2c6a8bf7e4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13127b6a-6e9f-49fd-b9c1-f9339ca50071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume ed858347-99bf-4197-9825-8116e2344752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed858347-99bf-4197-9825-8116e2344752', 'volume_size': 1}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:59 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9d344695-3f56-4feb-bfa4-ec4c0756accd" returned: 0 in 0.982s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] <== create_volume: return (2694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.696s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1303240656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37184080-848e-40ec-bc5f-4a019bbd12f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9583f0d6aca946d39bd2f7a952d09595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:57Z,use_quota=True,user_id='2e761b9399cd47c69a32c99b0c2c2f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Creating volume 37184080-848e-40ec-bc5f-4a019bbd12f4 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:36:59 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-37184080-848e-40ec-bc5f-4a019bbd12f4 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e35504-d78c-406a-b37c-6c49edea29ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d344695-3f56-4feb-bfa4-ec4c0756accd', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:59 devstack sudo[101660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-37184080-848e-40ec-bc5f-4a019bbd12f4 1073741824
Sep 29 12:36:59 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fdb9ed-c611-4431-bcc8-e64d39ce4cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:36:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume volume-9d344695-3f56-4feb-bfa4-ec4c0756accd (9d344695-3f56-4feb-bfa4-ec4c0756accd): created successfully
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fdb9ed-c611-4431-bcc8-e64d39ce4cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:36:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Flow 'volume_create_manager' (35d52282-ccac-42cc-974d-255d7f906717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:36:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3f7f2725-09fc-4a1b-bef5-40c37c3afcaa tempest-CreateVolumesFromSnapshotTest-328092905 None] Created volume successfully.
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Flow 'volume_create_manager' (c91faf9b-4574-4aea-9609-f83aade5357e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b6ceb0-7af3-4667-b65e-65ffc041e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b6ceb0-7af3-4667-b65e-65ffc041e59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-523109548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c23b7d1-580d-413d-a48e-201321317e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9583f0d6aca946d39bd2f7a952d09595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:00Z,use_quota=True,user_id='2e761b9399cd47c69a32c99b0c2c2f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdcdad0-d9b8-43e9-9ed4-58d832071f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdcdad0-d9b8-43e9-9ed4-58d832071f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72cc50f-cd38-4d4c-b0fb-8dabee73b414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72cc50f-cd38-4d4c-b0fb-8dabee73b414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c23b7d1-580d-413d-a48e-201321317e46', 'volume_name': 'volume-9c23b7d1-580d-413d-a48e-201321317e46', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe62d80-3689-4445-bec7-7f30bb767889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe62d80-3689-4445-bec7-7f30bb767889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32fe4ba9-c4e7-41d1-bd2b-1c820742c87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:00 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume 9c23b7d1-580d-413d-a48e-201321317e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c23b7d1-580d-413d-a48e-201321317e46', 'volume_size': 1}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:00 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Flow 'volume_create_manager' (1e672ad4-e48e-4587-911f-3901ef478693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60c8cd9-0f81-480e-a158-20442023bda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-37184080-848e-40ec-bc5f-4a019bbd12f4 1073741824" returned: 0 in 1.427s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60c8cd9-0f81-480e-a158-20442023bda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-811398267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9583f0d6aca946d39bd2f7a952d09595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:01Z,use_quota=True,user_id='2e761b9399cd47c69a32c99b0c2c2f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e8f59c-d481-43f4-93f8-bb1685729cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e8f59c-d481-43f4-93f8-bb1685729cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a116719-b272-46ab-933d-28ffd1b791b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a116719-b272-46ab-933d-28ffd1b791b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd475d6d8-d5b3-4f0e-a1c0-e6913841cfa8', 'volume_name': 'volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fef48fb-404d-47c7-9c35-7588f1454d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fef48fb-404d-47c7-9c35-7588f1454d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5aca38-d420-4d73-ad10-d42aec606196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:00 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8', 'volume_size': 1}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-37184080-848e-40ec-bc5f-4a019bbd12f4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:00 devstack sudo[101690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-37184080-848e-40ec-bc5f-4a019bbd12f4
Sep 29 12:37:00 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:01 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-37184080-848e-40ec-bc5f-4a019bbd12f4" returned: 0 in 0.460s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] <== create_volume: return (2109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.229s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647200989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed858347-99bf-4197-9825-8116e2344752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9583f0d6aca946d39bd2f7a952d09595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:36:58Z,use_quota=True,user_id='2e761b9399cd47c69a32c99b0c2c2f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Creating volume ed858347-99bf-4197-9825-8116e2344752 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:37:01 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ed858347-99bf-4197-9825-8116e2344752 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d7dbf5-8a3e-4d15-b480-a45f767c6e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37184080-848e-40ec-bc5f-4a019bbd12f4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f03e2d-0353-4b5a-bbdc-ad0ef4325d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:01 devstack sudo[101694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ed858347-99bf-4197-9825-8116e2344752 1073741824
Sep 29 12:37:01 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:01 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume volume-37184080-848e-40ec-bc5f-4a019bbd12f4 (37184080-848e-40ec-bc5f-4a019bbd12f4): created successfully
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f03e2d-0353-4b5a-bbdc-ad0ef4325d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Flow 'volume_create_manager' (9791a56a-563b-409b-be02-4963b0e80fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:01 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5986267e-d377-4fe9-9f0d-2abd6f5fdb1c tempest-CreateVolumesFromSnapshotTest-328092905 None] Created volume successfully.
Sep 29 12:37:02 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ed858347-99bf-4197-9825-8116e2344752 1073741824" returned: 0 in 0.847s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:02 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=64,cinder:UPDATE=43,cinder:DELETE=7,cinder:INSERT=12 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:37:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ed858347-99bf-4197-9825-8116e2344752 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:02 devstack sudo[101700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ed858347-99bf-4197-9825-8116e2344752
Sep 29 12:37:02 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:02 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ed858347-99bf-4197-9825-8116e2344752" returned: 0 in 0.627s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:37:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.828s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-523109548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c23b7d1-580d-413d-a48e-201321317e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9583f0d6aca946d39bd2f7a952d09595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:00Z,use_quota=True,user_id='2e761b9399cd47c69a32c99b0c2c2f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Creating volume 9c23b7d1-580d-413d-a48e-201321317e46 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:37:03 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9c23b7d1-580d-413d-a48e-201321317e46 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13127b6a-6e9f-49fd-b9c1-f9339ca50071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed858347-99bf-4197-9825-8116e2344752', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e70f1b-09df-4570-bd54-9427f98e9e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:03 devstack sudo[101705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9c23b7d1-580d-413d-a48e-201321317e46 1073741824
Sep 29 12:37:03 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:03 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume volume-ed858347-99bf-4197-9825-8116e2344752 (ed858347-99bf-4197-9825-8116e2344752): created successfully
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e70f1b-09df-4570-bd54-9427f98e9e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Flow 'volume_create_manager' (fc7441b7-6960-48fb-af84-898fd4278036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ef7a8e49-df9c-4c0c-9b87-fd353b089d3a tempest-CreateVolumesFromSnapshotTest-328092905 None] Created volume successfully.
Sep 29 12:37:03 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9c23b7d1-580d-413d-a48e-201321317e46 1073741824" returned: 0 in 0.739s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9c23b7d1-580d-413d-a48e-201321317e46 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:03 devstack sudo[101711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9c23b7d1-580d-413d-a48e-201321317e46
Sep 29 12:37:03 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:04 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9c23b7d1-580d-413d-a48e-201321317e46" returned: 0 in 0.318s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.261s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-811398267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9583f0d6aca946d39bd2f7a952d09595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:01Z,use_quota=True,user_id='2e761b9399cd47c69a32c99b0c2c2f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Creating volume d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:37:04 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:04 devstack sudo[101714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8 1073741824
Sep 29 12:37:04 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32fe4ba9-c4e7-41d1-bd2b-1c820742c87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c23b7d1-580d-413d-a48e-201321317e46', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1785a1a1-815c-42bc-96f2-b5f036364b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume volume-9c23b7d1-580d-413d-a48e-201321317e46 (9c23b7d1-580d-413d-a48e-201321317e46): created successfully
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1785a1a1-815c-42bc-96f2-b5f036364b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Flow 'volume_create_manager' (c91faf9b-4574-4aea-9609-f83aade5357e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9f5c1f97-e4a0-4ecc-bc9d-981b9bb6c564 tempest-CreateVolumesFromSnapshotTest-328092905 None] Created volume successfully.
Sep 29 12:37:04 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8 1073741824" returned: 0 in 0.689s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:04 devstack sudo[101721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8
Sep 29 12:37:04 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:05 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:37:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5aca38-d420-4d73-ad10-d42aec606196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdaee5e-f82c-489f-9ccc-5ba9cd9d92b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Volume volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8 (d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8): created successfully
Sep 29 12:37:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdaee5e-f82c-489f-9ccc-5ba9cd9d92b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Flow 'volume_create_manager' (1e672ad4-e48e-4587-911f-3901ef478693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-996a1398-fff7-4882-8cba-f0b882889d43 tempest-CreateVolumesFromSnapshotTest-328092905 None] Created volume successfully.
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b131c32-48ac-47b6-955d-a23cb0c16940]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:06 devstack sudo[101726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208
Sep 29 12:37:06 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-quobyte-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:06 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" returned: 0 in 0.469s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[33908d6d-491f-4dfb-a626-45d70068d428]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e41984-60da-4a47-925f-27b336cc7332]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:06 devstack sudo[101733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8
Sep 29 12:37:06 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:06 devstack sudo[101734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208
Sep 29 12:37:06 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:07 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8" returned: 0 in 0.440s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:07 devstack sudo[101744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8
Sep 29 12:37:07 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:07 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" returned: 0 in 0.475s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.22bd0b23-c663-4455-bd7f-4d97d36193eedstnvx9d.img {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:07 devstack sudo[101746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.22bd0b23-c663-4455-bd7f-4d97d36193eedstnvx9d.img
Sep 29 12:37:07 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:07 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8" returned: 0 in 0.319s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8" released by "delete_volume" :: held 0.820s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Created reservations ['9ca28cbc-6915-423a-ab59-881b5e7f2868', 'b6390fab-8a16-46f8-8605-c72d8c9432af', 'aa232fb1-db86-4b87-af91-b14b9d437c30', 'ef5d90e9-6d61-457b-abce-e062c8ed354a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:07 devstack sudo[101761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:37:07 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-9c23b7d1-580d-413d-a48e-201321317e46-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-9c23b7d1-580d-413d-a48e-201321317e46-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:07 devstack sudo[101763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:37:07 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-quobyte-9c23b7d1-580d-413d-a48e-201321317e46" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-9c23b7d1-580d-413d-a48e-201321317e46" acquired by "delete_volume" :: waited 0.056s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17ab8b1-2f02-4781-a24b-b77d4024b953]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9c23b7d1-580d-413d-a48e-201321317e46 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:08 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.680s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:37:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Deleted volume successfully.
Sep 29 12:37:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c81a4248-210e-46f1-a86b-7933609835e9 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-d475d6d8-d5b3-4f0e-a1c0-e6913841cfa8-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:08 devstack sudo[101765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9c23b7d1-580d-413d-a48e-201321317e46
Sep 29 12:37:08 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:08 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.721s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:37:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:37:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:37:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:37:09 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9c23b7d1-580d-413d-a48e-201321317e46" returned: 0 in 0.871s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9c23b7d1-580d-413d-a48e-201321317e46 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:09 devstack sudo[101772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9c23b7d1-580d-413d-a48e-201321317e46
Sep 29 12:37:09 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:09 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9c23b7d1-580d-413d-a48e-201321317e46" returned: 0 in 0.405s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-9c23b7d1-580d-413d-a48e-201321317e46" released by "delete_volume" :: held 1.419s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:09 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Created reservations ['14aff4c9-8f76-43a4-832f-5c9057363340', '19301fcd-7571-42f4-a9f3-0448d211bbd8', 'f976bba9-982b-4ad7-a70e-d6c08f3ebd7f', '040e4100-070c-458d-bd19-197479a2e339'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:37:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:09 devstack sudo[101779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:37:09 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-ed858347-99bf-4197-9825-8116e2344752-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-ed858347-99bf-4197-9825-8116e2344752-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:10 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.753s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:10 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:37:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-quobyte-ed858347-99bf-4197-9825-8116e2344752" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Deleted volume successfully.
Sep 29 12:37:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-ed858347-99bf-4197-9825-8116e2344752" acquired by "delete_volume" :: waited 0.049s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22a11da7-d59e-4012-afb9-b61089844b3b tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-9c23b7d1-580d-413d-a48e-201321317e46-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98c95ac-1f2a-4a15-b3cc-5aa5db7ab35e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ed858347-99bf-4197-9825-8116e2344752 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:10 devstack sudo[101782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ed858347-99bf-4197-9825-8116e2344752
Sep 29 12:37:10 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:11 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ed858347-99bf-4197-9825-8116e2344752" returned: 0 in 0.758s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ed858347-99bf-4197-9825-8116e2344752 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:11 devstack sudo[101788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ed858347-99bf-4197-9825-8116e2344752
Sep 29 12:37:11 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:12 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ed858347-99bf-4197-9825-8116e2344752" returned: 0 in 0.646s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-ed858347-99bf-4197-9825-8116e2344752" released by "delete_volume" :: held 1.512s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:12 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Created reservations ['02a09047-93f4-424d-97e8-2489053e3a07', '3a17c453-41bd-48fa-8947-5afcc3923d0a', '20d3e56e-4c96-45fa-9a6f-270f4960f3a1', '0f742078-f2db-4cbf-98ce-d54488a5ac61'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:37:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:12 devstack sudo[101796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:37:12 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-37184080-848e-40ec-bc5f-4a019bbd12f4-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-37184080-848e-40ec-bc5f-4a019bbd12f4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:13 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.866s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:13 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:37:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-quobyte-37184080-848e-40ec-bc5f-4a019bbd12f4" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Deleted volume successfully.
Sep 29 12:37:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-37184080-848e-40ec-bc5f-4a019bbd12f4" acquired by "delete_volume" :: waited 0.063s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1bbd877d-ad0e-4663-bdf8-6107ca78b748 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-ed858347-99bf-4197-9825-8116e2344752-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65f0d03-bebd-45f0-a52b-a31c71c612af]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-37184080-848e-40ec-bc5f-4a019bbd12f4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:13 devstack sudo[101818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-37184080-848e-40ec-bc5f-4a019bbd12f4
Sep 29 12:37:13 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:14 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-37184080-848e-40ec-bc5f-4a019bbd12f4" returned: 0 in 0.978s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-37184080-848e-40ec-bc5f-4a019bbd12f4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:14 devstack sudo[101825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-37184080-848e-40ec-bc5f-4a019bbd12f4
Sep 29 12:37:14 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:15 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-37184080-848e-40ec-bc5f-4a019bbd12f4" returned: 0 in 0.520s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-37184080-848e-40ec-bc5f-4a019bbd12f4" released by "delete_volume" :: held 1.629s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Created reservations ['ed936d10-11dd-436a-9044-5c04009258a5', 'f62161b0-913c-44c0-a4d4-f6b2d783e576', '212c5de4-4146-4072-8b0e-212f4aa7331d', '2306f650-cb20-41cc-98ac-45c44d7133e7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:37:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-4bd8876d-53ad-4732-a40d-321bd8486e31 tempest-TestShelveInstance-1211941693 None] Terminate volume connection completed successfully.
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-4bd8876d-53ad-4732-a40d-321bd8486e31 tempest-TestShelveInstance-1211941693 None] Deleting attachment ade2c762-f631-4156-b6dc-391f2282db04. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:15 devstack sudo[101831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:37:15 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Acquiring lock "cinder-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Lock "cinder-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Acquiring lock "cinder-quobyte-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Lock "cinder-quobyte-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd" acquired by "delete_volume" :: waited 0.045s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-9d344695-3f56-4feb-bfa4-ec4c0756accd-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f4c824-0bbf-43f7-b9e5-7c37fd785eef]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-9d344695-3f56-4feb-bfa4-ec4c0756accd-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:16 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-quobyte-9d344695-3f56-4feb-bfa4-ec4c0756accd" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.816s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:16 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:37:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Deleted volume successfully.
Sep 29 12:37:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-9d344695-3f56-4feb-bfa4-ec4c0756accd" acquired by "delete_volume" :: waited 0.074s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:16 devstack sudo[101833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd
Sep 29 12:37:16 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac98cad-04cf-4ca1-b643-0502a91be32c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a47a72dd-0fcc-4d45-b892-b9c2566162e2 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-37184080-848e-40ec-bc5f-4a019bbd12f4-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9d344695-3f56-4feb-bfa4-ec4c0756accd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:16 devstack sudo[101836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9d344695-3f56-4feb-bfa4-ec4c0756accd
Sep 29 12:37:16 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:16 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd" returned: 0 in 0.963s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:16 devstack sudo[101841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd
Sep 29 12:37:16 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:17 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9d344695-3f56-4feb-bfa4-ec4c0756accd" returned: 0 in 0.951s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9d344695-3f56-4feb-bfa4-ec4c0756accd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:17 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd" returned: 0 in 0.510s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:17 devstack sudo[101848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9d344695-3f56-4feb-bfa4-ec4c0756accd
Sep 29 12:37:17 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Lock "cinder-quobyte-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd" released by "delete_volume" :: held 1.629s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:17 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.22bd0b23-c663-4455-bd7f-4d97d36193eedstnvx9d.img" returned: 0 in 10.313s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3416afb-6ecc-41d1-8f62-b2a0fd252014]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG cinder.quota [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Created reservations ['36092130-0026-46b3-bff9-032361e2c2d7', '38fd367e-c9c6-4f34-bd1a-e7ec1953676e', '699c0a9e-f476-45c3-97e1-e53093da7a02', '43a4ea5c-ad68-4b06-93f9-e57e2c88d71a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:17 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9d344695-3f56-4feb-bfa4-ec4c0756accd" returned: 0 in 0.399s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:17 devstack sudo[101852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:37:17 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:17 devstack sudo[101850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208
Sep 29 12:37:17 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-9d344695-3f56-4feb-bfa4-ec4c0756accd" released by "delete_volume" :: held 1.535s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Created reservations ['9139b18d-f0d1-4594-98e0-4e4edd50fe3f', 'e322c3bb-ad74-4e85-baf0-52daacc3593d', '3943a807-f66f-484d-bb2f-0393443ea03a', 'fe94d29b-3e1e-477e-9387-0a67794a5923'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:18 devstack sudo[101856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:37:18 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:18 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.322s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.manager [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:37:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Deleted volume successfully.
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [req-a780c2ec-68c7-4327-9173-0407e2271d0d req-767f8877-ed87-4a72-8db3-dbac30d43850 tempest-TestShelveInstance-1211941693 None] Lock "cinder-fb27d2f3-ae6c-4b85-b1b8-4239bd02a1fd-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:18 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.349s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:37:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Deleted volume successfully.
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-86373894-b5c3-4bbb-a59d-a6028622c58c tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-9d344695-3f56-4feb-bfa4-ec4c0756accd-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-93f4757d-e7af-4431-8f3a-f01113e74be6-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-93f4757d-e7af-4431-8f3a-f01113e74be6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-quobyte-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:18 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" returned: 0 in 0.942s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208, size 1024.00 MB, duration 10.31 sec, destination /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.22bd0b23-c663-4455-bd7f-4d97d36193eedstnvx9d.img {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:37:18 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] Converted 1024.00 MB image at 99.28 MB/s
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] 22bd0b23-c663-4455-bd7f-4d97d36193ee was raw, no need to convert to raw {{(pid=86369) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-quobyte-93f4757d-e7af-4431-8f3a-f01113e74be6" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-93f4757d-e7af-4431-8f3a-f01113e74be6" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Deleting offline snapshot 93f4757d-e7af-4431-8f3a-f01113e74be6 of volume a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] snapshot_file for this snap is: volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f455bb4-2b94-4105-99d0-dc422010c6e3]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:18 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6
Sep 29 12:37:18 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:19 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6" returned: 0 in 0.561s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:37:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[10894440-6f0f-4c5b-bb4f-e3bd5121fe81]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:19 devstack sudo[101869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d
Sep 29 12:37:19 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:19 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d" returned: 0 in 0.465s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:19 devstack sudo[101883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6
Sep 29 12:37:19 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:20 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6" returned: 0 in 0.451s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:20 devstack sudo[101891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6
Sep 29 12:37:20 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:20 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d.93f4757d-e7af-4431-8f3a-f01113e74be6" returned: 0 in 0.429s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-93f4757d-e7af-4431-8f3a-f01113e74be6" released by "_delete_snapshot" :: held 2.139s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d" released by "delete_snapshot" :: held 2.211s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:20 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Created reservations ['81af58fd-45c4-4269-8b82-56c092708948', 'e6053f53-d5e2-40aa-b962-51b47657362a', 'fa36909e-b52e-4831-a2be-8a607d0afe0c', 'c8e178bd-47da-47b5-bd77-e5804fb00434'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:37:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Delete snapshot completed successfully.
Sep 29 12:37:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c31e3abb-1fd5-40bb-8477-eff93a8f735e tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-93f4757d-e7af-4431-8f3a-f01113e74be6-delete_snapshot" released by "delete_snapshot" :: held 2.574s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-7defd309-80e1-4f01-92c7-6b71eb9e0c24 req-2d38dc1b-5a7e-48eb-9c11-27cafa2bdd16 tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "cinder-quobyte-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7143e531-8ecc-4e08-8ecc-5fcbb581e013]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:22 devstack sudo[101906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d
Sep 29 12:37:22 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:22 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d" returned: 0 in 0.495s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:22 devstack sudo[101911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d
Sep 29 12:37:22 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:22 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d" returned: 0 in 0.360s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-quobyte-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d" released by "delete_volume" :: held 0.953s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:22 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Created reservations ['81821eb8-8aaa-4b35-b7a8-554ead2d0796', '47f8a461-9a75-4403-8994-06dfd7fdd401', '520bd8c4-40c0-4335-891a-360acd6a7866', '42addf24-6023-41cf-952f-4e27393b1699'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:37:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:23 devstack sudo[101914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:37:23 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:23 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:23 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:37:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Deleted volume successfully.
Sep 29 12:37:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e9a3aee-a623-4236-bf77-cc69db07e854 tempest-CreateVolumesFromSnapshotTest-328092905 None] Lock "cinder-a4aa5771-44ad-4d69-8e5d-0e2ef8cb251d-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:33 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=65,cinder:UPDATE=87,cinder:DELETE=7,cinder:INSERT=21 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:37:33 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=63,cinder:SELECT=45,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:37:35 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:37:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Flow 'volume_create_manager' (6fb116a8-a634-4464-8543-f52dd4dd90fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ad129d-4153-4f77-9a51-612a79a10954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ad129d-4153-4f77-9a51-612a79a10954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96314860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f32aa5-11c2-45cb-b54c-8521dc41ec3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e42a1fbb8b4407842495895a726a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:36Z,use_quota=True,user_id='69cb7769a47b4be0aa4488496389baf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f602a381-02ae-4423-b38d-8eaf3e277599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f602a381-02ae-4423-b38d-8eaf3e277599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f419115d-90f1-4d64-810f-f7ba832e5f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f419115d-90f1-4d64-810f-f7ba832e5f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f32aa5-11c2-45cb-b54c-8521dc41ec3a', 'volume_name': 'volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640722f3-8932-4ad6-9798-4549592991b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640722f3-8932-4ad6-9798-4549592991b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d815f2-87d5-4148-a0bc-f0da0ddb43dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Volume 08f32aa5-11c2-45cb-b54c-8521dc41ec3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a', 'volume_size': 1}
Sep 29 12:37:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:39 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:37:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Flow 'volume_create_manager' (cc34dd14-c75c-4c51-acbf-791cc55fd8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db75058-9007-4cf7-87d1-92e9c02731dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db75058-9007-4cf7-87d1-92e9c02731dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba28e7e6-6e7f-4457-a904-9c20e9dd32f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69f89d5a10f4498a9c12bc922de4d8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:40Z,use_quota=True,user_id='728c86630ff84882af986f81ce56fb9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67bbed2d-bcaf-41d3-ac40-15133c9d779b),volume_type_id=67bbed2d-bcaf-41d3-ac40-15133c9d779b)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a7ce4a-c1b3-44f6-9926-cba8f9e8e100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a7ce4a-c1b3-44f6-9926-cba8f9e8e100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a7e030-a98c-414b-af65-c855c712c77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a7e030-a98c-414b-af65-c855c712c77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba28e7e6-6e7f-4457-a904-9c20e9dd32f1', 'volume_name': 'volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1', 'volume_size': 1, 'image_id': '4df156b2-a503-4787-a4f6-9ce1640315f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4df156b2-a503-4787-a4f6-9ce1640315f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab27207781b5e134cff7406db5817faa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69f89d5a10f4498a9c12bc922de4d8ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '40423fbbb81124c671a6200c6c2c5e5ebf4870e242f2d1e9d63f4564eb829de1c4680dea7bc77e43491d2ffb3e8f535652b0a622dacf6041d92a125effc341f3', 'id': '4df156b2-a503-4787-a4f6-9ce1640315f6', 'created_at': datetime.datetime(2026, 9, 29, 10, 37, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 37, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4df156b2-a503-4787-a4f6-9ce1640315f6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701b2a7d40>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cec874-cc35-42a4-a7a8-4eb532e9514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cec874-cc35-42a4-a7a8-4eb532e9514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4982edc-eeb9-4d40-baf0-62e2f8fa3b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:40 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Volume ba28e7e6-6e7f-4457-a904-9c20e9dd32f1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1', 'volume_size': 1, 'image_id': '4df156b2-a503-4787-a4f6-9ce1640315f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4df156b2-a503-4787-a4f6-9ce1640315f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab27207781b5e134cff7406db5817faa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69f89d5a10f4498a9c12bc922de4d8ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '40423fbbb81124c671a6200c6c2c5e5ebf4870e242f2d1e9d63f4564eb829de1c4680dea7bc77e43491d2ffb3e8f535652b0a622dacf6041d92a125effc341f3', 'id': '4df156b2-a503-4787-a4f6-9ce1640315f6', 'created_at': datetime.datetime(2026, 9, 29, 10, 37, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 37, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4df156b2-a503-4787-a4f6-9ce1640315f6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701b2a7d40>}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Trying to clone ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 from image 4df156b2-a503-4787-a4f6-9ce1640315f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4df156b2-a503-4787-a4f6-9ce1640315f6', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 12:37:40 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Image download 0.00 MB at 0.00 MB/s
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6a71b6-8daf-46d8-a24d-21664ce5bf94]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:40 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD
Sep 29 12:37:40 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:40 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:41 devstack sudo[101930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD
Sep 29 12:37:41 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:41 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:37:41 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Temporary image 4df156b2-a503-4787-a4f6-9ce1640315f6 is fetched for user 728c86630ff84882af986f81ce56fb9f. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 12:37:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f374a92f-11bb-42ec-8809-29b0cc1faee1]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:41 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD
Sep 29 12:37:41 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:41 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:42 devstack sudo[101939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD
Sep 29 12:37:42 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.944s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] Uploaded volume to glance image-id: 22bd0b23-c663-4455-bd7f-4d97d36193ee. {{(pid=86369) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-7defd309-80e1-4f01-92c7-6b71eb9e0c24 req-2d38dc1b-5a7e-48eb-9c11-27cafa2bdd16 tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 20.613s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-87ba499f-f7f0-4b85-b6bf-54723362b475 tempest-VolumesActionsTest-1221306815 None] Copy volume to image completed successfully.
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-7defd309-80e1-4f01-92c7-6b71eb9e0c24 req-2d38dc1b-5a7e-48eb-9c11-27cafa2bdd16 tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.136s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96314860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f32aa5-11c2-45cb-b54c-8521dc41ec3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e42a1fbb8b4407842495895a726a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:36Z,use_quota=True,user_id='69cb7769a47b4be0aa4488496389baf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Creating volume 08f32aa5-11c2-45cb-b54c-8521dc41ec3a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:37:42 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:42 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a 1073741824
Sep 29 12:37:42 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-7defd309-80e1-4f01-92c7-6b71eb9e0c24 req-2d38dc1b-5a7e-48eb-9c11-27cafa2bdd16 tempest-TestInstancesWithCinderVolumes-624594648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-976c0cf3-84ff-4e31-aabe-59c263ee5040', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c99d186-9f37-441a-b7bb-a680cad3cf8d', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:37:42 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-7defd309-80e1-4f01-92c7-6b71eb9e0c24 req-2d38dc1b-5a7e-48eb-9c11-27cafa2bdd16 tempest-TestInstancesWithCinderVolumes-624594648 None] attachment_update completed successfully.
Sep 29 12:37:42 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a 1073741824" returned: 0 in 0.539s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:42 devstack sudo[101956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a
Sep 29 12:37:42 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:43 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a" returned: 0 in 0.314s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.803s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba28e7e6-6e7f-4457-a904-9c20e9dd32f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69f89d5a10f4498a9c12bc922de4d8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:40Z,use_quota=True,user_id='728c86630ff84882af986f81ce56fb9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67bbed2d-bcaf-41d3-ac40-15133c9d779b),volume_type_id=67bbed2d-bcaf-41d3-ac40-15133c9d779b)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Creating volume ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:37:43 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d815f2-87d5-4148-a0bc-f0da0ddb43dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:43 devstack sudo[101959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 1073741824
Sep 29 12:37:43 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ebb957-cb84-48a2-ac95-07611270048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:43 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Volume volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a (08f32aa5-11c2-45cb-b54c-8521dc41ec3a): created successfully
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ebb957-cb84-48a2-ac95-07611270048a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Flow 'volume_create_manager' (6fb116a8-a634-4464-8543-f52dd4dd90fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:43 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f5ae63c5-a450-4939-983b-c64a880ec360 tempest-ProjectReaderTests-754664520 None] Created volume successfully.
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 1073741824" returned: 0 in 0.560s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:43 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:43 devstack sudo[101969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1
Sep 29 12:37:43 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Acquiring lock "cinder-08f32aa5-11c2-45cb-b54c-8521dc41ec3a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Lock "cinder-08f32aa5-11c2-45cb-b54c-8521dc41ec3a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Acquiring lock "cinder-quobyte-08f32aa5-11c2-45cb-b54c-8521dc41ec3a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Lock "cinder-quobyte-08f32aa5-11c2-45cb-b54c-8521dc41ec3a" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:43 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98cecc5-560a-442c-80b7-d05f8491b521]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:44 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1" returned: 0 in 0.319s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Attempting download of 4df156b2-a503-4787-a4f6-9ce1640315f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4df156b2-a503-4787-a4f6-9ce1640315f6', 'metadata': {}}])) to volume ba28e7e6-6e7f-4457-a904-9c20e9dd32f1. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cef5e5-189b-48f7-ac27-9d3a0ebb9288]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4df156b2-a503-4787-a4f6-9ce1640315f6_ayecp5da {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:44 devstack sudo[101974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a
Sep 29 12:37:44 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:44 devstack sudo[101975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4df156b2-a503-4787-a4f6-9ce1640315f6_ayecp5da
Sep 29 12:37:44 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9f7938-262a-4065-a05b-199c2907c7d9]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:44 devstack sudo[101981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208
Sep 29 12:37:44 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:44 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:44 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4df156b2-a503-4787-a4f6-9ce1640315f6_ayecp5da" returned: 0 in 0.424s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4df156b2-a503-4787-a4f6-9ce1640315f6_ayecp5da {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a" returned: 0 in 0.570s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:44 devstack sudo[101990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a
Sep 29 12:37:44 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:44 devstack sudo[101989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4df156b2-a503-4787-a4f6-9ce1640315f6_ayecp5da
Sep 29 12:37:44 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:44 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" returned: 0 in 0.531s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed39c576-a211-4e86-ac3c-a55d505c6e06]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:44 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-08f32aa5-11c2-45cb-b54c-8521dc41ec3a" returned: 0 in 0.355s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Lock "cinder-quobyte-08f32aa5-11c2-45cb-b54c-8521dc41ec3a" released by "delete_volume" :: held 0.996s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:45 devstack sudo[102003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208
Sep 29 12:37:45 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Created reservations ['8e2f38e4-640e-4386-b5fb-a139dbaea451', 'f828b957-e6e2-495c-8a16-adb46fc3fe78', '98debc6e-8916-43c5-9d65-bf350772847e', '5e7a2b6c-b6fd-40ca-9f06-55040ff6a5bd'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:37:45 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4df156b2-a503-4787-a4f6-9ce1640315f6_ayecp5da" returned: 1 in 0.521s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4df156b2-a503-4787-a4f6-9ce1640315f6_ayecp5da' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec30beac-6d73-455f-bbb4-f61e8c300d62]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-039c51aa-dfd5-44b6-9c81-19ef621294ce req-2fde8697-a9e7-4443-8332-80596e8984d7 tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:45 devstack sudo[102009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD
Sep 29 12:37:45 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:45 devstack sudo[102010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:37:45 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:45 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" returned: 0 in 0.428s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:45 devstack sudo[102016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img
Sep 29 12:37:45 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:45 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:45 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:37:45 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Deleted volume successfully.
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-16b65a9a-fd32-4a96-8f77-19aa2ecd03b9 tempest-ProjectReaderTests-754664520 None] Lock "cinder-08f32aa5-11c2-45cb-b54c-8521dc41ec3a-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:45 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD
Sep 29 12:37:45 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:45 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD" returned: 1 in 0.498s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] 4df156b2-a503-4787-a4f6-9ce1640315f6 was raw, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 12:37:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:46 devstack sudo[102036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1
Sep 29 12:37:46 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:47 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1" returned: 0 in 1.086s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4df156b2-a503-4787-a4f6-9ce1640315f6_4obkcaledevstack@QuobyteHD, size 0.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:37:47 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Converted 0.00 MB image at 0.00 MB/s
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:47 devstack sudo[102042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 1G
Sep 29 12:37:47 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Flow 'volume_create_manager' (b9772375-d900-478e-93a5-b3bc9df1505b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:47 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f8cf31-80e9-457c-a43d-19c2f4698c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 1G" returned: 0 in 0.622s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Downloaded image 4df156b2-a503-4787-a4f6-9ce1640315f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4df156b2-a503-4787-a4f6-9ce1640315f6', 'metadata': {}}])) to volume ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Temporary image 4df156b2-a503-4787-a4f6-9ce1640315f6 for user 728c86630ff84882af986f81ce56fb9f is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Marking volume ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f8cf31-80e9-457c-a43d-19c2f4698c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1136675458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c04830-df13-435a-9dee-40f2a5d24b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e42a1fbb8b4407842495895a726a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:48Z,use_quota=True,user_id='69cb7769a47b4be0aa4488496389baf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33e1918-1d87-431f-bb71-aaee2afbfbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33e1918-1d87-431f-bb71-aaee2afbfbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c77cd85-388d-43dd-8953-8ff66087e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c77cd85-388d-43dd-8953-8ff66087e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c04830-df13-435a-9dee-40f2a5d24b08', 'volume_name': 'volume-57c04830-df13-435a-9dee-40f2a5d24b08', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7cb4320-a8a9-4899-a71d-68d394e83142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7cb4320-a8a9-4899-a71d-68d394e83142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb22530-d3fe-4717-9ad6-dbb85ab33e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:47 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Volume 57c04830-df13-435a-9dee-40f2a5d24b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c04830-df13-435a-9dee-40f2a5d24b08', 'volume_size': 1}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Copying metadata from image 4df156b2-a503-4787-a4f6-9ce1640315f6 to ba28e7e6-6e7f-4457-a904-9c20e9dd32f1. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Creating volume glance metadata for volume ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 backed by image 4df156b2-a503-4787-a4f6-9ce1640315f6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4df156b2-a503-4787-a4f6-9ce1640315f6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ab27207781b5e134cff7406db5817faa', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4982edc-eeb9-4d40-baf0-62e2f8fa3b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1', 'volume_size': 1, 'image_id': '4df156b2-a503-4787-a4f6-9ce1640315f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4df156b2-a503-4787-a4f6-9ce1640315f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab27207781b5e134cff7406db5817faa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69f89d5a10f4498a9c12bc922de4d8ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '40423fbbb81124c671a6200c6c2c5e5ebf4870e242f2d1e9d63f4564eb829de1c4680dea7bc77e43491d2ffb3e8f535652b0a622dacf6041d92a125effc341f3', 'id': '4df156b2-a503-4787-a4f6-9ce1640315f6', 'created_at': datetime.datetime(2026, 9, 29, 10, 37, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 37, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4df156b2-a503-4787-a4f6-9ce1640315f6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701b2a7d40>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee74d626-b6a5-4033-921f-8c06acab22e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:47 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Volume volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 (ba28e7e6-6e7f-4457-a904-9c20e9dd32f1): created successfully
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee74d626-b6a5-4033-921f-8c06acab22e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Flow 'volume_create_manager' (cc34dd14-c75c-4c51-acbf-791cc55fd8eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-637654dd-6691-4e9d-b7e9-80bc3263ef39 tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Created volume successfully.
Sep 29 12:37:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Acquiring lock "cinder-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Lock "cinder-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Acquiring lock "cinder-quobyte-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Lock "cinder-quobyte-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:48 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ff4342-834b-441e-9763-76b4282edc97]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:48 devstack sudo[102049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1
Sep 29 12:37:48 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:49 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1" returned: 0 in 0.581s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:49 devstack sudo[102054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1
Sep 29 12:37:49 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:49 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1" returned: 0 in 0.531s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Lock "cinder-quobyte-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1" released by "delete_volume" :: held 1.212s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:49 devstack cinder-volume[86369]: WARNING cinder.quota [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:37:49 devstack cinder-volume[86369]: WARNING cinder.quota [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:37:49 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Created reservations ['605b4565-48d6-4fac-ae09-6ff430981f9d', '55646d97-0250-475d-98ca-0ecb159c4cbd', 'ba8fb0ef-981b-4d17-b440-07efad87e3ab', '9964420a-3853-48d2-99ba-c3d2eec24bc2'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:37:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:49 devstack sudo[102057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:37:49 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:50 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.439s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:50 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:37:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Deleted volume successfully.
Sep 29 12:37:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d314380a-40af-4cd3-b52a-32d30250b37e tempest-VolumeAndVolumeTypeFromImageTest-1602430941 None] Lock "cinder-ba28e7e6-6e7f-4457-a904-9c20e9dd32f1-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:52 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img" returned: 0 in 7.187s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:52 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca8bbb8-9fba-436c-8d4b-3b677e558845]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:52 devstack sudo[102060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208
Sep 29 12:37:52 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:53 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" returned: 0 in 0.573s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:53 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208, size 1024.00 MB, duration 7.19 sec, destination /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:37:53 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Converted 1024.00 MB image at 142.45 MB/s
Sep 29 12:37:53 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] f73c6172-12fc-4725-ab22-11f646b56bc1 was raw, converting to qcow2 {{(pid=86369) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 29 12:37:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5807b1c3-8659-4bc0-8a15-1243f5d84b64]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:53 devstack sudo[102065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img
Sep 29 12:37:53 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:53 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img" returned: 0 in 0.349s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:53 devstack sudo[102069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img
Sep 29 12:37:53 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:53 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img" returned: 1 in 0.422s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:37:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img /opt/stack/data/cinder/conversion/vol_upload_czrlmxeh {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:53 devstack sudo[102075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img /opt/stack/data/cinder/conversion/vol_upload_czrlmxeh
Sep 29 12:37:53 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:54 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img /opt/stack/data/cinder/conversion/vol_upload_czrlmxeh" returned: 0 in 0.292s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:54 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Image conversion details: src /opt/stack/data/cinder/conversion/b3edcbeb-7bcb-4ce6-8355-c893bbbaa208.temp_image.f73c6172-12fc-4725-ab22-11f646b56bc1sac5oskk.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_czrlmxeh {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:37:54 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 29 12:37:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe3dbba-b341-4ac5-ab00-ac0be8f6de79]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_czrlmxeh {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:54 devstack sudo[102080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_czrlmxeh
Sep 29 12:37:54 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:54 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_czrlmxeh" returned: 0 in 0.373s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.363s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Uploaded volume to glance image-id: f73c6172-12fc-4725-ab22-11f646b56bc1. {{(pid=86369) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-039c51aa-dfd5-44b6-9c81-19ef621294ce req-2fde8697-a9e7-4443-8332-80596e8984d7 tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.534s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-039c51aa-dfd5-44b6-9c81-19ef621294ce req-2fde8697-a9e7-4443-8332-80596e8984d7 tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.936s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1136675458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c04830-df13-435a-9dee-40f2a5d24b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e42a1fbb8b4407842495895a726a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:48Z,use_quota=True,user_id='69cb7769a47b4be0aa4488496389baf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Creating volume 57c04830-df13-435a-9dee-40f2a5d24b08 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:37:56 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57c04830-df13-435a-9dee-40f2a5d24b08 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5159b012-cd7d-44d1-957c-6913d3b44c0a tempest-VolumesActionsTest-1221306815 None] Copy volume to image completed successfully.
Sep 29 12:37:56 devstack sudo[102128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57c04830-df13-435a-9dee-40f2a5d24b08 1073741824
Sep 29 12:37:56 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:56 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-039c51aa-dfd5-44b6-9c81-19ef621294ce req-2fde8697-a9e7-4443-8332-80596e8984d7 tempest-TestInstancesWithCinderVolumes-624594648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65033170-02e3-46fc-a9ad-486021b743a7', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:37:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-039c51aa-dfd5-44b6-9c81-19ef621294ce req-2fde8697-a9e7-4443-8332-80596e8984d7 tempest-TestInstancesWithCinderVolumes-624594648 None] attachment_update completed successfully.
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Flow 'volume_create_manager' (d87a4673-d4f0-427a-a7a4-77602e87530f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680ee392-86cb-457e-b8ab-be73566ee5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680ee392-86cb-457e-b8ab-be73566ee5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1877596386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164d4182-567c-4b52-8244-46c7c4602ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475da679994a47fcb839d48a249a14b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:57Z,use_quota=True,user_id='b37d8e0eb5494807a77796bc5ae0053a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708e80b1-6e69-4585-a0b0-be1f1ed59a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708e80b1-6e69-4585-a0b0-be1f1ed59a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7ad9db-0972-4ba6-9261-e390fad9525d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7ad9db-0972-4ba6-9261-e390fad9525d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164d4182-567c-4b52-8244-46c7c4602ee3', 'volume_name': 'volume-164d4182-567c-4b52-8244-46c7c4602ee3', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b5fd0b-3e5c-477a-8885-a8db12eadfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b5fd0b-3e5c-477a-8885-a8db12eadfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1b3bbe-a130-430f-b1f3-f1ac0f6ac509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:57 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Volume 164d4182-567c-4b52-8244-46c7c4602ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164d4182-567c-4b52-8244-46c7c4602ee3', 'volume_size': 1}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:57 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57c04830-df13-435a-9dee-40f2a5d24b08 1073741824" returned: 0 in 0.810s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57c04830-df13-435a-9dee-40f2a5d24b08 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:57 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57c04830-df13-435a-9dee-40f2a5d24b08
Sep 29 12:37:57 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Flow 'volume_create_manager' (c9e41c7d-84d2-4c03-9bac-faa191d94fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03876885-32e2-4a45-9bfd-30450ae297cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03876885-32e2-4a45-9bfd-30450ae297cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-140094524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44033bc1-070b-4bee-83ad-c4b2e1f01139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475da679994a47fcb839d48a249a14b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:58Z,use_quota=True,user_id='b37d8e0eb5494807a77796bc5ae0053a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9472a2-a010-4a24-8c41-6819fb06de95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9472a2-a010-4a24-8c41-6819fb06de95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24467a5-bea2-4e4b-97f4-4da837937838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24467a5-bea2-4e4b-97f4-4da837937838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44033bc1-070b-4bee-83ad-c4b2e1f01139', 'volume_name': 'volume-44033bc1-070b-4bee-83ad-c4b2e1f01139', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748d8ad3-89dd-4901-8e3c-a802aa8f0b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748d8ad3-89dd-4901-8e3c-a802aa8f0b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb11b5c-8ccf-4893-ba13-ea3d57ad1f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:57 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Volume 44033bc1-070b-4bee-83ad-c4b2e1f01139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44033bc1-070b-4bee-83ad-c4b2e1f01139', 'volume_size': 1}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:57 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57c04830-df13-435a-9dee-40f2a5d24b08" returned: 0 in 0.390s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.744s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1877596386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164d4182-567c-4b52-8244-46c7c4602ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475da679994a47fcb839d48a249a14b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:57Z,use_quota=True,user_id='b37d8e0eb5494807a77796bc5ae0053a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Creating volume 164d4182-567c-4b52-8244-46c7c4602ee3 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:37:57 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:37:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164d4182-567c-4b52-8244-46c7c4602ee3 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:58 devstack sudo[102142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164d4182-567c-4b52-8244-46c7c4602ee3 1073741824
Sep 29 12:37:58 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb22530-d3fe-4717-9ad6-dbb85ab33e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c04830-df13-435a-9dee-40f2a5d24b08', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b87ece-1a42-4938-819e-1df8f734612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:58 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Volume volume-57c04830-df13-435a-9dee-40f2a5d24b08 (57c04830-df13-435a-9dee-40f2a5d24b08): created successfully
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b87ece-1a42-4938-819e-1df8f734612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Flow 'volume_create_manager' (b9772375-d900-478e-93a5-b3bc9df1505b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0d2bbb00-b614-4bfe-b50f-9d8547505194 tempest-ProjectReaderTests-754664520 None] Created volume successfully.
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Acquiring lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Acquiring lock "cinder-quobyte-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Lock "cinder-quobyte-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" acquired by "delete_volume" :: waited 0.040s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a308780-a0a9-4da5-b2cf-b5df42e15cbb]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:58 devstack sudo[102146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208
Sep 29 12:37:58 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Acquiring lock "cinder-57c04830-df13-435a-9dee-40f2a5d24b08-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Lock "cinder-57c04830-df13-435a-9dee-40f2a5d24b08-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:58 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164d4182-567c-4b52-8244-46c7c4602ee3 1073741824" returned: 0 in 0.749s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Acquiring lock "cinder-quobyte-57c04830-df13-435a-9dee-40f2a5d24b08" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164d4182-567c-4b52-8244-46c7c4602ee3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Lock "cinder-quobyte-57c04830-df13-435a-9dee-40f2a5d24b08" acquired by "delete_volume" :: waited 0.048s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:37:58 devstack sudo[102154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164d4182-567c-4b52-8244-46c7c4602ee3
Sep 29 12:37:58 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3f5235-b67e-428b-8cb2-e8f739f161e5]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:37:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57c04830-df13-435a-9dee-40f2a5d24b08 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:59 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" returned: 0 in 0.712s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:59 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208
Sep 29 12:37:59 devstack sudo[102159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57c04830-df13-435a-9dee-40f2a5d24b08
Sep 29 12:37:59 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:59 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Flow 'volume_create_manager' (9e2c7429-b6c5-4eb6-9d09-54bb88aea92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffb46a2-d127-46b2-8255-736ea99134e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffb46a2-d127-46b2-8255-736ea99134e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1914910928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d951c31-746c-4ee3-a3a0-ff989c35d2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475da679994a47fcb839d48a249a14b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:59Z,use_quota=True,user_id='b37d8e0eb5494807a77796bc5ae0053a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51173c77-d76a-4b26-ad90-25514ce30efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51173c77-d76a-4b26-ad90-25514ce30efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c13dc9e-345a-4870-a379-50ea00958bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c13dc9e-345a-4870-a379-50ea00958bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d951c31-746c-4ee3-a3a0-ff989c35d2b6', 'volume_name': 'volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17071695-c780-408c-932a-471af7e0b55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17071695-c780-408c-932a-471af7e0b55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81e23ce-4201-42ff-a683-74346077afe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Volume 4d951c31-746c-4ee3-a3a0-ff989c35d2b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6', 'volume_size': 1}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Flow 'volume_create_manager' (6a2314fa-6f28-4b4a-ab57-a15720a62dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:59 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89db58f-8f6a-4162-aab0-60b0a614bd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164d4182-567c-4b52-8244-46c7c4602ee3" returned: 0 in 0.595s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-140094524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44033bc1-070b-4bee-83ad-c4b2e1f01139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475da679994a47fcb839d48a249a14b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:58Z,use_quota=True,user_id='b37d8e0eb5494807a77796bc5ae0053a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Creating volume 44033bc1-070b-4bee-83ad-c4b2e1f01139 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:37:59 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-44033bc1-070b-4bee-83ad-c4b2e1f01139 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89db58f-8f6a-4162-aab0-60b0a614bd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-195008304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fac09a4-2798-4b5a-872d-f76a4d0b4c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475da679994a47fcb839d48a249a14b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:59Z,use_quota=True,user_id='b37d8e0eb5494807a77796bc5ae0053a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e944d8-63be-4fa3-993f-6a7d99a57eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack sudo[102168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-44033bc1-070b-4bee-83ad-c4b2e1f01139 1073741824
Sep 29 12:37:59 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e944d8-63be-4fa3-993f-6a7d99a57eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37df9939-1688-4e95-a2aa-e9269c626dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37df9939-1688-4e95-a2aa-e9269c626dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fac09a4-2798-4b5a-872d-f76a4d0b4c10', 'volume_name': 'volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff25e82-fd31-4700-a7da-04d431ac633e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff25e82-fd31-4700-a7da-04d431ac633e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c46d629-c35b-4dcb-98d7-8be9c880bf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Volume 6fac09a4-2798-4b5a-872d-f76a4d0b4c10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10', 'volume_size': 1}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1b3bbe-a130-430f-b1f3-f1ac0f6ac509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164d4182-567c-4b52-8244-46c7c4602ee3', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62849c44-d86d-4363-92ee-8386464621eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" returned: 0 in 0.604s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:59 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57c04830-df13-435a-9dee-40f2a5d24b08" returned: 0 in 0.811s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57c04830-df13-435a-9dee-40f2a5d24b08 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Lock "cinder-quobyte-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208" released by "delete_volume" :: held 1.408s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:37:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Volume volume-164d4182-567c-4b52-8244-46c7c4602ee3 (164d4182-567c-4b52-8244-46c7c4602ee3): created successfully
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62849c44-d86d-4363-92ee-8386464621eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Flow 'volume_create_manager' (d87a4673-d4f0-427a-a7a4-77602e87530f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:59 devstack sudo[102175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57c04830-df13-435a-9dee-40f2a5d24b08
Sep 29 12:37:59 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:37:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-13fffdb1-3b2b-4344-86f0-5b9452dcc8ca tempest-CreateVolumesFromImageTest-190907581 None] Created volume successfully.
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Flow 'volume_create_manager' (3b557966-051e-4185-8529-a4ed6e080264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904b7af2-7947-4b1f-94aa-b97bff2a4ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904b7af2-7947-4b1f-94aa-b97bff2a4ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1631549697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d91361-9ec5-4b71-8ddf-a5536b0927c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475da679994a47fcb839d48a249a14b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:00Z,use_quota=True,user_id='b37d8e0eb5494807a77796bc5ae0053a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9841de31-fa38-4434-95cc-130ff1786487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:37:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9841de31-fa38-4434-95cc-130ff1786487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f937ba-1dc0-4bd9-b889-1686a7d4f74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f937ba-1dc0-4bd9-b889-1686a7d4f74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d91361-9ec5-4b71-8ddf-a5536b0927c7', 'volume_name': 'volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794bfc32-b256-4bfa-8a93-0bcbfe138674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794bfc32-b256-4bfa-8a93-0bcbfe138674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693c32b4-17a6-4064-aab5-ae4ebe1ae621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:00 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Volume 40d91361-9ec5-4b71-8ddf-a5536b0927c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7', 'volume_size': 1}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Created reservations ['58b9e41a-cc11-4923-9a8a-e59042635d0a', 'a4b10f53-8884-47bf-8f3f-f65e8c086226', '3b61777b-7a28-4ed4-88fe-78c3f4e31108', '9cbd2ff2-519e-4ac9-8b5b-f1f1d3acf5e2'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:00 devstack sudo[102181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:00 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:00 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-44033bc1-070b-4bee-83ad-c4b2e1f01139 1073741824" returned: 0 in 0.720s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:00 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57c04830-df13-435a-9dee-40f2a5d24b08" returned: 0 in 0.489s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Lock "cinder-quobyte-57c04830-df13-435a-9dee-40f2a5d24b08" released by "delete_volume" :: held 1.387s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-44033bc1-070b-4bee-83ad-c4b2e1f01139 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:00 devstack sudo[102184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-44033bc1-070b-4bee-83ad-c4b2e1f01139
Sep 29 12:38:00 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Created reservations ['932efc91-3c9c-44d3-98bb-f6f17280553d', '8d58b3e9-ac96-46d9-87ca-e7aa50927e58', '88d565eb-7fdf-49bb-a0b2-d1fc9b8836fa', '9748eca2-218d-484f-aab3-31d5890072e5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:00 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.300s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:00 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Deleted volume successfully.
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff23b0a1-26a1-468d-be21-1e11ff626613 tempest-VolumesActionsTest-1221306815 None] Lock "cinder-b3edcbeb-7bcb-4ce6-8355-c893bbbaa208-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:00 devstack sudo[102187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:00 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:00 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-44033bc1-070b-4bee-83ad-c4b2e1f01139" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1914910928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d951c31-746c-4ee3-a3a0-ff989c35d2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475da679994a47fcb839d48a249a14b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:59Z,use_quota=True,user_id='b37d8e0eb5494807a77796bc5ae0053a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Creating volume 4d951c31-746c-4ee3-a3a0-ff989c35d2b6 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:00 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb11b5c-8ccf-4893-ba13-ea3d57ad1f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44033bc1-070b-4bee-83ad-c4b2e1f01139', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b9c126-0fae-4f98-9ae2-680c3ff82252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:00 devstack sudo[102190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6 1073741824
Sep 29 12:38:00 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:00 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Volume volume-44033bc1-070b-4bee-83ad-c4b2e1f01139 (44033bc1-070b-4bee-83ad-c4b2e1f01139): created successfully
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b9c126-0fae-4f98-9ae2-680c3ff82252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Flow 'volume_create_manager' (c9e41c7d-84d2-4c03-9bac-faa191d94fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:00 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-79e62e8a-59a8-4ca1-9582-9f2b5d3d354e tempest-CreateVolumesFromImageTest-190907581 None] Created volume successfully.
Sep 29 12:38:00 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.425s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:00 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Deleted volume successfully.
Sep 29 12:38:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-70dfdbb7-e274-4fd5-8f34-01452b8928b3 tempest-ProjectReaderTests-754664520 None] Lock "cinder-57c04830-df13-435a-9dee-40f2a5d24b08-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:01 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6 1073741824" returned: 0 in 0.734s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:01 devstack sudo[102197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6
Sep 29 12:38:01 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Flow 'volume_create_manager' (218b547c-6d27-430d-b298-fa208db364fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbcc77c5-9856-4a6a-9e9e-f010e2967def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbcc77c5-9856-4a6a-9e9e-f010e2967def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-293073817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3664cf0c-be78-45c4-858f-b3d123cced32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e42a1fbb8b4407842495895a726a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:02Z,use_quota=True,user_id='69cb7769a47b4be0aa4488496389baf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3207c8a-8af8-4e19-865c-0dbb687d6c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:01 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3207c8a-8af8-4e19-865c-0dbb687d6c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ae2e7c-696c-4d31-b655-0d4ff523c7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ae2e7c-696c-4d31-b655-0d4ff523c7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3664cf0c-be78-45c4-858f-b3d123cced32', 'volume_name': 'volume-3664cf0c-be78-45c4-858f-b3d123cced32', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5df79b5-5569-4c88-910e-e71efbdab946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5df79b5-5569-4c88-910e-e71efbdab946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf313c8a-0ced-4d7b-baec-5c63457114a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:01 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Volume 3664cf0c-be78-45c4-858f-b3d123cced32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3664cf0c-be78-45c4-858f-b3d123cced32', 'volume_size': 1}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6" returned: 0 in 0.476s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.316s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-195008304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fac09a4-2798-4b5a-872d-f76a4d0b4c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475da679994a47fcb839d48a249a14b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:37:59Z,use_quota=True,user_id='b37d8e0eb5494807a77796bc5ae0053a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Creating volume 6fac09a4-2798-4b5a-872d-f76a4d0b4c10 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:01 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:02 devstack sudo[102204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10 1073741824
Sep 29 12:38:02 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81e23ce-4201-42ff-a683-74346077afe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d965240-3e90-4e37-a7ea-075f30e5d693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:02 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Volume volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6 (4d951c31-746c-4ee3-a3a0-ff989c35d2b6): created successfully
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d965240-3e90-4e37-a7ea-075f30e5d693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Flow 'volume_create_manager' (9e2c7429-b6c5-4eb6-9d09-54bb88aea92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:02 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8eac06aa-42a0-4a5f-aa17-0ce7f3fdbdb8 tempest-CreateVolumesFromImageTest-190907581 None] Created volume successfully.
Sep 29 12:38:02 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10 1073741824" returned: 0 in 0.583s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:02 devstack sudo[102221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10
Sep 29 12:38:02 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:02 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10" returned: 0 in 0.342s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.941s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1631549697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d91361-9ec5-4b71-8ddf-a5536b0927c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475da679994a47fcb839d48a249a14b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:00Z,use_quota=True,user_id='b37d8e0eb5494807a77796bc5ae0053a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Creating volume 40d91361-9ec5-4b71-8ddf-a5536b0927c7 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:02 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c46d629-c35b-4dcb-98d7-8be9c880bf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:03 devstack sudo[102231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7 1073741824
Sep 29 12:38:03 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b29ae4-073d-4a85-b072-1803700b9fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:03 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Volume volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10 (6fac09a4-2798-4b5a-872d-f76a4d0b4c10): created successfully
Sep 29 12:38:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b29ae4-073d-4a85-b072-1803700b9fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Flow 'volume_create_manager' (6a2314fa-6f28-4b4a-ab57-a15720a62dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-944c2118-ec00-4efe-9aff-ffbe9780de3d tempest-CreateVolumesFromImageTest-190907581 None] Created volume successfully.
Sep 29 12:38:03 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7 1073741824" returned: 0 in 0.656s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:03 devstack sudo[102239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7
Sep 29 12:38:03 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:04 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7" returned: 0 in 0.324s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.059s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-293073817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3664cf0c-be78-45c4-858f-b3d123cced32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e42a1fbb8b4407842495895a726a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:02Z,use_quota=True,user_id='69cb7769a47b4be0aa4488496389baf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Creating volume 3664cf0c-be78-45c4-858f-b3d123cced32 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:04 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3664cf0c-be78-45c4-858f-b3d123cced32 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693c32b4-17a6-4064-aab5-ae4ebe1ae621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb9eb20-ba22-42a9-8450-3567d3022532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:04 devstack sudo[102246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3664cf0c-be78-45c4-858f-b3d123cced32 1073741824
Sep 29 12:38:04 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Volume volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7 (40d91361-9ec5-4b71-8ddf-a5536b0927c7): created successfully
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb9eb20-ba22-42a9-8450-3567d3022532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Flow 'volume_create_manager' (3b557966-051e-4185-8529-a4ed6e080264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-90ab4cfe-9bba-4be6-a984-84b6701f0998 tempest-CreateVolumesFromImageTest-190907581 None] Created volume successfully.
Sep 29 12:38:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-f7c62b2c-bf97-40f6-9093-e3633004c76f req-b975e254-ed51-4806-95e3-871143b78428 tempest-TestInstancesWithCinderVolumes-624594648 None] Terminate volume connection completed successfully.
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-f7c62b2c-bf97-40f6-9093-e3633004c76f req-b975e254-ed51-4806-95e3-871143b78428 tempest-TestInstancesWithCinderVolumes-624594648 None] Deleting attachment 1c99d186-9f37-441a-b7bb-a680cad3cf8d. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "cinder-40d91361-9ec5-4b71-8ddf-a5536b0927c7-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-40d91361-9ec5-4b71-8ddf-a5536b0927c7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "cinder-quobyte-40d91361-9ec5-4b71-8ddf-a5536b0927c7" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:04 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3664cf0c-be78-45c4-858f-b3d123cced32 1073741824" returned: 0 in 0.614s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-quobyte-40d91361-9ec5-4b71-8ddf-a5536b0927c7" acquired by "delete_volume" :: waited 0.043s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df3e053-f0fb-439a-a425-8c5f57f5e9e8]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3664cf0c-be78-45c4-858f-b3d123cced32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:04 devstack sudo[102256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3664cf0c-be78-45c4-858f-b3d123cced32
Sep 29 12:38:04 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "cinder-976c0cf3-84ff-4e31-aabe-59c263ee5040-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "cinder-976c0cf3-84ff-4e31-aabe-59c263ee5040-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:04 devstack sudo[102255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7
Sep 29 12:38:04 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "cinder-quobyte-976c0cf3-84ff-4e31-aabe-59c263ee5040" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "cinder-quobyte-976c0cf3-84ff-4e31-aabe-59c263ee5040" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8737da53-1524-4104-a11f-e784bdbb9afe]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-976c0cf3-84ff-4e31-aabe-59c263ee5040 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:05 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3664cf0c-be78-45c4-858f-b3d123cced32" returned: 0 in 0.355s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf313c8a-0ced-4d7b-baec-5c63457114a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3664cf0c-be78-45c4-858f-b3d123cced32', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1964f39-6dce-462c-ac6b-07031fca2a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:05 devstack sudo[102263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-976c0cf3-84ff-4e31-aabe-59c263ee5040
Sep 29 12:38:05 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Volume volume-3664cf0c-be78-45c4-858f-b3d123cced32 (3664cf0c-be78-45c4-858f-b3d123cced32): created successfully
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1964f39-6dce-462c-ac6b-07031fca2a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Flow 'volume_create_manager' (218b547c-6d27-430d-b298-fa208db364fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4e3c137c-e167-456d-b019-8a3af774ce6a tempest-ProjectReaderTests-754664520 None] Created volume successfully.
Sep 29 12:38:05 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7" returned: 0 in 0.539s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:05 devstack sudo[102269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7
Sep 29 12:38:05 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:05 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-976c0cf3-84ff-4e31-aabe-59c263ee5040" returned: 0 in 0.485s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-976c0cf3-84ff-4e31-aabe-59c263ee5040 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:05 devstack sudo[102276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-976c0cf3-84ff-4e31-aabe-59c263ee5040
Sep 29 12:38:05 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:05 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-40d91361-9ec5-4b71-8ddf-a5536b0927c7" returned: 0 in 0.522s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-quobyte-40d91361-9ec5-4b71-8ddf-a5536b0927c7" released by "delete_volume" :: held 1.142s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:05 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-976c0cf3-84ff-4e31-aabe-59c263ee5040" returned: 0 in 0.439s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "cinder-quobyte-976c0cf3-84ff-4e31-aabe-59c263ee5040" released by "delete_volume" :: held 1.006s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:05 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Created reservations ['5ca7f86a-a908-46ef-8e46-ec5becaaf1b9', '6869914d-cd12-4f53-bccf-04ab55c7b7e7', 'c2bfca36-c5e1-4203-95c1-9e5b4388e9d3', '0d21a58a-e8bd-4fbb-a962-a7ec589f22b1'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:05 devstack cinder-volume[86369]: WARNING cinder.quota [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2008212214-1594159444 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2008212214-1594159444, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:38:05 devstack cinder-volume[86369]: WARNING cinder.quota [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2008212214-1594159444 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2008212214-1594159444, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Created reservations ['dceaf964-2c54-4315-a44e-1c10f8d808e0', '1c6182be-9425-42a8-ac8a-1ce1154da980', 'a0c929a3-a2a9-47f9-8858-0c4338748024', 'f1eb96cc-60f7-431e-bffa-acb277cab350'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Acquiring lock "cinder-3664cf0c-be78-45c4-858f-b3d123cced32-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:06 devstack sudo[102280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:06 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Lock "cinder-3664cf0c-be78-45c4-858f-b3d123cced32-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:06 devstack sudo[102282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:06 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Acquiring lock "cinder-quobyte-3664cf0c-be78-45c4-858f-b3d123cced32" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Lock "cinder-quobyte-3664cf0c-be78-45c4-858f-b3d123cced32" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[346785af-b247-44c7-9ee6-78da40bb08ce]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3664cf0c-be78-45c4-858f-b3d123cced32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:06 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Deleted volume successfully.
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f8b8a8c2-c671-4ae6-b4af-55bece9f2cfe tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-40d91361-9ec5-4b71-8ddf-a5536b0927c7-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:06 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:06 devstack sudo[102285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3664cf0c-be78-45c4-858f-b3d123cced32
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.323s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:06 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Deleted volume successfully.
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cf9ffe0e-5d69-419c-8b88-ca04293a5dac tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "cinder-976c0cf3-84ff-4e31-aabe-59c263ee5040-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "cinder-6fac09a4-2798-4b5a-872d-f76a4d0b4c10-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-6fac09a4-2798-4b5a-872d-f76a4d0b4c10-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:07 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3664cf0c-be78-45c4-858f-b3d123cced32" returned: 0 in 0.581s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3664cf0c-be78-45c4-858f-b3d123cced32 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:07 devstack sudo[102291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3664cf0c-be78-45c4-858f-b3d123cced32
Sep 29 12:38:07 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "cinder-quobyte-6fac09a4-2798-4b5a-872d-f76a4d0b4c10" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-quobyte-6fac09a4-2798-4b5a-872d-f76a4d0b4c10" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bf49d7-66a1-416e-bb10-88bce040c1fb]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:07 devstack sudo[102294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10
Sep 29 12:38:07 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:07 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3664cf0c-be78-45c4-858f-b3d123cced32" returned: 0 in 0.399s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Lock "cinder-quobyte-3664cf0c-be78-45c4-858f-b3d123cced32" released by "delete_volume" :: held 1.047s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Created reservations ['e55bb468-a0bf-4b38-bf04-3318f319edb7', '5e2b9fca-81bd-40c6-8799-eb66b2385952', '5dfa66b4-c4a5-4d04-a512-59542c45a269', '4a8de042-9d6b-4517-ad00-0d0a12a8af91'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:07 devstack sudo[102303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:07 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:07 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10" returned: 0 in 0.563s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:07 devstack sudo[102309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10
Sep 29 12:38:07 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:07 devstack sudo[102311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:07 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:07 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.320s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:07 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Deleted volume successfully.
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-58f05110-af1d-400a-badd-52b7394b471c tempest-ProjectReaderTests-754664520 None] Lock "cinder-3664cf0c-be78-45c4-858f-b3d123cced32-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:08 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6fac09a4-2798-4b5a-872d-f76a4d0b4c10" returned: 0 in 0.431s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-quobyte-6fac09a4-2798-4b5a-872d-f76a4d0b4c10" released by "delete_volume" :: held 1.098s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:08 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.409s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Created reservations ['dcf8d971-cac6-48a3-ad84-6637116311d6', '80f2604c-7ef3-4627-a67f-184d97e704e8', '40c5c87d-1963-444c-b138-6a14974ba776', '8424d789-a49d-48cf-b6fb-59d9455bfc98'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:08 devstack sudo[102326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:08 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:08 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.370s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Deleted volume successfully.
Sep 29 12:38:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2bb2c015-cff9-4b99-9f82-285fbb057e49 tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-6fac09a4-2798-4b5a-872d-f76a4d0b4c10-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Flow 'volume_create_manager' (fd8b3462-4dc9-456e-a07c-bcd005e65cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e056cad3-5f3c-410d-81ae-e8050f79aa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e056cad3-5f3c-410d-81ae-e8050f79aa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910006598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27177140-3147-424c-a1e8-4535be7f7cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e42a1fbb8b4407842495895a726a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:09Z,use_quota=True,user_id='69cb7769a47b4be0aa4488496389baf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8ef804-85e1-4ec6-bd13-8227e309fcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8ef804-85e1-4ec6-bd13-8227e309fcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75ba774-a7ba-438a-8cb3-d0fff9d761ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75ba774-a7ba-438a-8cb3-d0fff9d761ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27177140-3147-424c-a1e8-4535be7f7cf7', 'volume_name': 'volume-27177140-3147-424c-a1e8-4535be7f7cf7', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd9532a-264a-4b19-a37c-ff5bfc55a7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd9532a-264a-4b19-a37c-ff5bfc55a7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c491b3-6590-4ca4-bb17-9e672e7f11ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:09 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Volume 27177140-3147-424c-a1e8-4535be7f7cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27177140-3147-424c-a1e8-4535be7f7cf7', 'volume_size': 1}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910006598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27177140-3147-424c-a1e8-4535be7f7cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e42a1fbb8b4407842495895a726a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:09Z,use_quota=True,user_id='69cb7769a47b4be0aa4488496389baf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Creating volume 27177140-3147-424c-a1e8-4535be7f7cf7 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:09 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-27177140-3147-424c-a1e8-4535be7f7cf7 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:09 devstack sudo[102335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-27177140-3147-424c-a1e8-4535be7f7cf7 1073741824
Sep 29 12:38:09 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "cinder-4d951c31-746c-4ee3-a3a0-ff989c35d2b6-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-4d951c31-746c-4ee3-a3a0-ff989c35d2b6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "cinder-quobyte-4d951c31-746c-4ee3-a3a0-ff989c35d2b6" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-quobyte-4d951c31-746c-4ee3-a3a0-ff989c35d2b6" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e150a0d-c6e1-4f63-bce8-2bb0c7b1e7fe]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:09 devstack sudo[102339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6
Sep 29 12:38:09 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-7128e0aa-a5ac-4a3f-8a45-e133e77df9b1 req-1db6c354-dcd5-4071-a467-dc140f608aa7 tempest-TestInstancesWithCinderVolumes-624594648 None] Terminate volume connection completed successfully.
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-7128e0aa-a5ac-4a3f-8a45-e133e77df9b1 req-1db6c354-dcd5-4071-a467-dc140f608aa7 tempest-TestInstancesWithCinderVolumes-624594648 None] Deleting attachment 65033170-02e3-46fc-a9ad-486021b743a7. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:38:09 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-27177140-3147-424c-a1e8-4535be7f7cf7 1073741824" returned: 0 in 0.713s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-27177140-3147-424c-a1e8-4535be7f7cf7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:10 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6" returned: 0 in 0.536s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:10 devstack sudo[102352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-27177140-3147-424c-a1e8-4535be7f7cf7
Sep 29 12:38:10 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:10 devstack sudo[102353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6
Sep 29 12:38:10 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:10 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-27177140-3147-424c-a1e8-4535be7f7cf7" returned: 0 in 0.304s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c491b3-6590-4ca4-bb17-9e672e7f11ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27177140-3147-424c-a1e8-4535be7f7cf7', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bccc0d-199d-4d7b-b1df-3b7fe573a526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:10 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Volume volume-27177140-3147-424c-a1e8-4535be7f7cf7 (27177140-3147-424c-a1e8-4535be7f7cf7): created successfully
Sep 29 12:38:10 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bccc0d-199d-4d7b-b1df-3b7fe573a526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Flow 'volume_create_manager' (fd8b3462-4dc9-456e-a07c-bcd005e65cf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d951c31-746c-4ee3-a3a0-ff989c35d2b6" returned: 0 in 0.334s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-04a4e744-7cad-4bf2-900e-bf95bc95bf63 tempest-ProjectReaderTests-754664520 None] Created volume successfully.
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-quobyte-4d951c31-746c-4ee3-a3a0-ff989c35d2b6" released by "delete_volume" :: held 0.929s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "cinder-56c1ba54-9425-4cdb-ab45-00c27dcb7a66-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Created reservations ['3cab1b2a-9aa7-4f37-82db-b87e4ef01f88', 'ca14869a-e602-48c7-a288-57b1c84f8382', '96a57b1a-70ae-48f6-8575-6d77869c7995', 'f038cdf0-f35a-4acf-8f39-8edce6215000'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "cinder-56c1ba54-9425-4cdb-ab45-00c27dcb7a66-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "cinder-quobyte-56c1ba54-9425-4cdb-ab45-00c27dcb7a66" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "cinder-quobyte-56c1ba54-9425-4cdb-ab45-00c27dcb7a66" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[90389c0b-cef1-4435-929d-cf7ed17d9f4e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:10 devstack sudo[102359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:10 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:10 devstack sudo[102358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66
Sep 29 12:38:10 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:11 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Deleted volume successfully.
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a6f6fc28-575d-47d4-8d82-425ecea36a01 tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-4d951c31-746c-4ee3-a3a0-ff989c35d2b6-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:11 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66" returned: 0 in 0.566s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:11 devstack sudo[102366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66
Sep 29 12:38:11 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Acquiring lock "cinder-27177140-3147-424c-a1e8-4535be7f7cf7-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Lock "cinder-27177140-3147-424c-a1e8-4535be7f7cf7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Acquiring lock "cinder-quobyte-27177140-3147-424c-a1e8-4535be7f7cf7" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Lock "cinder-quobyte-27177140-3147-424c-a1e8-4535be7f7cf7" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc19c598-4de7-4938-89aa-9420398ec089]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-27177140-3147-424c-a1e8-4535be7f7cf7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:11 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-56c1ba54-9425-4cdb-ab45-00c27dcb7a66" returned: 0 in 0.356s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "cinder-quobyte-56c1ba54-9425-4cdb-ab45-00c27dcb7a66" released by "delete_volume" :: held 1.016s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:11 devstack cinder-volume[86369]: WARNING cinder.quota [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-851101677-1539077089 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-851101677-1539077089, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:38:11 devstack cinder-volume[86369]: WARNING cinder.quota [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-851101677-1539077089 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-851101677-1539077089, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "cinder-44033bc1-070b-4bee-83ad-c4b2e1f01139-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-44033bc1-070b-4bee-83ad-c4b2e1f01139-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Created reservations ['0cdf6b79-1469-4a2d-92b4-309da4194db5', 'bb1e7ece-bf35-4cc1-8ee8-5494e2c08793', '41ac037f-5b29-4d87-b945-dc52450de776', 'd9dadf7e-2fbb-4633-9525-ab747e7cc2c9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:11 devstack sudo[102368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-27177140-3147-424c-a1e8-4535be7f7cf7
Sep 29 12:38:11 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "cinder-quobyte-44033bc1-070b-4bee-83ad-c4b2e1f01139" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-quobyte-44033bc1-070b-4bee-83ad-c4b2e1f01139" acquired by "delete_volume" :: waited 0.043s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b957ed2d-8a23-47c8-bbe7-9a391db4a2ea]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-44033bc1-070b-4bee-83ad-c4b2e1f01139 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:12 devstack sudo[102372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:12 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:12 devstack sudo[102371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-44033bc1-070b-4bee-83ad-c4b2e1f01139
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (4a9393e4-593b-4226-871c-1a3d74334597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:12 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedd4ef3-daea-4f93-acab-92e2043539a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedd4ef3-daea-4f93-acab-92e2043539a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-929592992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7455ebb8-695a-4dca-8953-d7ef3af20411,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:12Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462cce4f-918a-4078-9331-def02377091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462cce4f-918a-4078-9331-def02377091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5c8a84-c376-49eb-9c73-8d2ab1112085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5c8a84-c376-49eb-9c73-8d2ab1112085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7455ebb8-695a-4dca-8953-d7ef3af20411', 'volume_name': 'volume-7455ebb8-695a-4dca-8953-d7ef3af20411', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39874e9d-3367-4173-8740-779e79ffa122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39874e9d-3367-4173-8740-779e79ffa122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aebe0af8-89cc-4e8d-8064-0a5802610eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Volume 7455ebb8-695a-4dca-8953-d7ef3af20411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7455ebb8-695a-4dca-8953-d7ef3af20411', 'volume_size': 1}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-929592992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7455ebb8-695a-4dca-8953-d7ef3af20411,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:12Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Creating volume 7455ebb8-695a-4dca-8953-d7ef3af20411 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:12 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7455ebb8-695a-4dca-8953-d7ef3af20411 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:12 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:12 devstack sudo[102379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7455ebb8-695a-4dca-8953-d7ef3af20411 1073741824
Sep 29 12:38:12 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-27177140-3147-424c-a1e8-4535be7f7cf7" returned: 0 in 0.740s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-27177140-3147-424c-a1e8-4535be7f7cf7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:12 devstack sudo[102381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-27177140-3147-424c-a1e8-4535be7f7cf7
Sep 29 12:38:12 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:12 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.437s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Deleted volume successfully.
Sep 29 12:38:12 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-44033bc1-070b-4bee-83ad-c4b2e1f01139" returned: 0 in 0.574s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-44033bc1-070b-4bee-83ad-c4b2e1f01139 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:12 devstack sudo[102389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-44033bc1-070b-4bee-83ad-c4b2e1f01139
Sep 29 12:38:12 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6e45f56a-440e-47b8-a198-bb3dc9e953aa tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "cinder-56c1ba54-9425-4cdb-ab45-00c27dcb7a66-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:12 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-27177140-3147-424c-a1e8-4535be7f7cf7" returned: 0 in 0.469s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Lock "cinder-quobyte-27177140-3147-424c-a1e8-4535be7f7cf7" released by "delete_volume" :: held 1.271s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Created reservations ['3fbc06e9-e41c-4f0f-9b26-2d3f7a427324', '74dc1411-9529-4ac7-8b3c-f4bbfb2c3781', '38c17fa5-2d15-4572-9142-b6b783f6fdd8', '8547918e-dca8-4751-b322-a3fe655dde90'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:12 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-44033bc1-070b-4bee-83ad-c4b2e1f01139" returned: 0 in 0.431s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:12 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-quobyte-44033bc1-070b-4bee-83ad-c4b2e1f01139" released by "delete_volume" :: held 1.118s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7455ebb8-695a-4dca-8953-d7ef3af20411 1073741824" returned: 0 in 0.810s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:13 devstack sudo[102397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:13 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7455ebb8-695a-4dca-8953-d7ef3af20411 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Created reservations ['8b7e1e3b-89d2-46dd-9d2a-d7b54d1a7489', 'e7de1c41-ccd4-48a7-a978-3c860f2e4682', '8e079893-6444-4871-aea1-6e3583d5021d', '746f138d-e45d-4b8e-8688-b5fce91013a4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:13 devstack sudo[102399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7455ebb8-695a-4dca-8953-d7ef3af20411
Sep 29 12:38:13 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:13 devstack sudo[102402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:13 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:13 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.380s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Deleted volume successfully.
Sep 29 12:38:13 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7455ebb8-695a-4dca-8953-d7ef3af20411" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-61137a11-9c27-4326-a595-d136825ab84b tempest-ProjectReaderTests-754664520 None] Lock "cinder-27177140-3147-424c-a1e8-4535be7f7cf7-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aebe0af8-89cc-4e8d-8064-0a5802610eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7455ebb8-695a-4dca-8953-d7ef3af20411', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f684fa-6816-49e2-ada0-f0c2e2b5e05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:13 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Volume volume-7455ebb8-695a-4dca-8953-d7ef3af20411 (7455ebb8-695a-4dca-8953-d7ef3af20411): created successfully
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f684fa-6816-49e2-ada0-f0c2e2b5e05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (4a9393e4-593b-4226-871c-1a3d74334597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9d330326-9186-4b4c-ac8a-d05f256117e7 tempest-VolumesGetTest-629353174 None] Created volume successfully.
Sep 29 12:38:13 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.346s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Deleted volume successfully.
Sep 29 12:38:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-89c6ad56-d13e-4e16-a227-f6f8f9983d70 tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-44033bc1-070b-4bee-83ad-c4b2e1f01139-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "cinder-164d4182-567c-4b52-8244-46c7c4602ee3-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-164d4182-567c-4b52-8244-46c7c4602ee3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "cinder-quobyte-164d4182-567c-4b52-8244-46c7c4602ee3" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-quobyte-164d4182-567c-4b52-8244-46c7c4602ee3" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e505324f-fa26-44cf-8c78-2bf568762ade]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164d4182-567c-4b52-8244-46c7c4602ee3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:14 devstack sudo[102408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164d4182-567c-4b52-8244-46c7c4602ee3
Sep 29 12:38:14 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:14 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164d4182-567c-4b52-8244-46c7c4602ee3" returned: 0 in 0.675s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164d4182-567c-4b52-8244-46c7c4602ee3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:14 devstack sudo[102419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164d4182-567c-4b52-8244-46c7c4602ee3
Sep 29 12:38:14 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:15 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164d4182-567c-4b52-8244-46c7c4602ee3" returned: 0 in 0.472s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-quobyte-164d4182-567c-4b52-8244-46c7c4602ee3" released by "delete_volume" :: held 1.232s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Created reservations ['25b515bd-961c-4021-bb6d-3e5f2ad87f53', 'a7ecfeec-ca22-4ee7-bf18-8eee43a8adec', 'd27ea1d4-ab99-4450-b2e2-86b9a3ae7318', '7d9f6e09-13c7-4631-9760-fc7fcb505f3d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:15 devstack sudo[102441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:15 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (ab7e5c50-5a34-4d79-b53f-03ac593da36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ecf80a-dacb-450f-9da7-d11745c1774b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ecf80a-dacb-450f-9da7-d11745c1774b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1485986903',display_name='tempest-VolumesGetTest-Volume-513132129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:16Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0063cd0-f38b-4c8f-a7aa-22af342ca1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0063cd0-f38b-4c8f-a7aa-22af342ca1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbb2ce2-dec0-4fd3-bcb4-31a5cac4b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbb2ce2-dec0-4fd3-bcb4-31a5cac4b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca', 'volume_name': 'volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f3bbb0-32c3-4f2b-abc3-7647a4bddbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f3bbb0-32c3-4f2b-abc3-7647a4bddbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7834c171-eac7-4414-a262-e5bed1fc2794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:15 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Volume ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca', 'volume_size': 1}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1485986903',display_name='tempest-VolumesGetTest-Volume-513132129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:16Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Creating volume ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:15 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:16 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.413s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:16 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Deleted volume successfully.
Sep 29 12:38:16 devstack sudo[102445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca 1073741824
Sep 29 12:38:16 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-038ce5c6-bfe7-4cb5-b578-1ec57978433e tempest-CreateVolumesFromImageTest-190907581 None] Lock "cinder-164d4182-567c-4b52-8244-46c7c4602ee3-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:16 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca 1073741824" returned: 0 in 0.649s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:16 devstack sudo[102452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca
Sep 29 12:38:16 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:17 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca" returned: 0 in 0.416s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7834c171-eac7-4414-a262-e5bed1fc2794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1def9599-4416-4675-bdbd-1cd7117c3313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Volume volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca (ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca): created successfully
Sep 29 12:38:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1def9599-4416-4675-bdbd-1cd7117c3313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (ab7e5c50-5a34-4d79-b53f-03ac593da36f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4b2008ff-9ad0-4136-905b-de2fd62a5718 tempest-VolumesGetTest-629353174 None] Created volume successfully.
Sep 29 12:38:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-ce7fcf05-d3bb-4dd9-bfdd-74c42a3be925 req-54613ade-293c-4c9f-bf22-25ccc080cc4a tempest-TestInstancesWithCinderVolumes-624594648 None] Terminate volume connection completed successfully.
Sep 29 12:38:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-ce7fcf05-d3bb-4dd9-bfdd-74c42a3be925 req-54613ade-293c-4c9f-bf22-25ccc080cc4a tempest-TestInstancesWithCinderVolumes-624594648 None] Deleting attachment ade4a059-3496-422b-a6f7-37ff54694ba4. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Lock "cinder-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-quobyte-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[78420a1b-162a-4590-822e-98e44fced042]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:18 devstack sudo[102456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca
Sep 29 12:38:18 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "cinder-a3e05c66-f915-44fc-930a-1068e70accde-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "cinder-a3e05c66-f915-44fc-930a-1068e70accde-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "cinder-quobyte-a3e05c66-f915-44fc-930a-1068e70accde" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "cinder-quobyte-a3e05c66-f915-44fc-930a-1068e70accde" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38b562c-a3e2-4f2a-a211-b9a4595e790d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:18 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca" returned: 0 in 0.462s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:18 devstack sudo[102464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca
Sep 29 12:38:18 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:18 devstack sudo[102460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde
Sep 29 12:38:18 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:18 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca" returned: 0 in 0.318s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca" released by "delete_volume" :: held 0.838s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:19 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde" returned: 0 in 0.491s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:19 devstack sudo[102471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde
Sep 29 12:38:19 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Created reservations ['492d4817-b708-4d10-81b5-035143649744', '4d501fe4-5f9c-44af-8d1a-421404b6edc6', '9e03b443-84e4-440d-863e-fa5dda19a10e', '5901c50e-95b2-4014-99cd-bed7064320b9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:19 devstack sudo[102473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:19 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:19 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a3e05c66-f915-44fc-930a-1068e70accde" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "cinder-quobyte-a3e05c66-f915-44fc-930a-1068e70accde" released by "delete_volume" :: held 0.838s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:19 devstack cinder-volume[86369]: WARNING cinder.quota [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1867451080-1169732100 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1867451080-1169732100, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:38:19 devstack cinder-volume[86369]: WARNING cinder.quota [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1867451080-1169732100 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1867451080-1169732100, it is now deprecated. Please use the default quota class for default quota.
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Created reservations ['b62bb388-2b89-4400-ab25-1c2298b84cdf', 'e6a08129-c1e0-4d5a-8442-4fba37ce87ca', '5889b38e-9c9b-4ae7-9235-ae626ebb8176', 'c02ed0df-d4a1-4b15-b587-14f17c650eed'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-7455ebb8-695a-4dca-8953-d7ef3af20411-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Lock "cinder-7455ebb8-695a-4dca-8953-d7ef3af20411-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:19 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.307s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Deleted volume successfully.
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c239742e-5b08-445e-b1c2-afa3bd69d090 tempest-VolumesGetTest-629353174 None] Lock "cinder-ea5607c4-fe4f-4594-8efd-7e2b9f9d6bca-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-quobyte-7455ebb8-695a-4dca-8953-d7ef3af20411" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-7455ebb8-695a-4dca-8953-d7ef3af20411" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[990f64d2-0d58-4ee2-8349-fc2241eb1b5c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7455ebb8-695a-4dca-8953-d7ef3af20411 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:19 devstack sudo[102477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:19 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:19 devstack sudo[102478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7455ebb8-695a-4dca-8953-d7ef3af20411
Sep 29 12:38:19 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:19 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.318s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Deleted volume successfully.
Sep 29 12:38:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b9178ddb-da53-4832-9c4c-ee175da54e7c tempest-TestInstancesWithCinderVolumes-624594648 None] Lock "cinder-a3e05c66-f915-44fc-930a-1068e70accde-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:20 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7455ebb8-695a-4dca-8953-d7ef3af20411" returned: 0 in 0.472s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7455ebb8-695a-4dca-8953-d7ef3af20411 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:20 devstack sudo[102485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7455ebb8-695a-4dca-8953-d7ef3af20411
Sep 29 12:38:20 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Flow 'volume_create_manager' (cc1f4b97-f658-45de-879d-d52f15c907d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68658069-e6ec-4b41-a0b5-e30f0ac00f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:20 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7455ebb8-695a-4dca-8953-d7ef3af20411" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68658069-e6ec-4b41-a0b5-e30f0ac00f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1741834855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a05c25-d3c9-42be-ab97-fd1af7d9598a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559912ada6493dbdc1367b4c0e9c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:20Z,use_quota=True,user_id='eb59ade950654044b7f1e3d9d727e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ccdde1-352b-4964-8afd-b0dfef5548f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ccdde1-352b-4964-8afd-b0dfef5548f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c2ee26-8979-4d3a-b913-ae7d3f22e5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c2ee26-8979-4d3a-b913-ae7d3f22e5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a05c25-d3c9-42be-ab97-fd1af7d9598a', 'volume_name': 'volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03afcb5-001e-4e6e-85a6-9dc47f67131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03afcb5-001e-4e6e-85a6-9dc47f67131b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec822cd-0c36-441a-8250-c12ec8899305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume 80a05c25-d3c9-42be-ab97-fd1af7d9598a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a', 'volume_size': 1}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1741834855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a05c25-d3c9-42be-ab97-fd1af7d9598a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559912ada6493dbdc1367b4c0e9c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:20Z,use_quota=True,user_id='eb59ade950654044b7f1e3d9d727e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Creating volume 80a05c25-d3c9-42be-ab97-fd1af7d9598a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:20 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-7455ebb8-695a-4dca-8953-d7ef3af20411" released by "delete_volume" :: held 0.912s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:20 devstack sudo[102488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a 1073741824
Sep 29 12:38:20 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Created reservations ['102566ed-1298-422c-926b-a11eeb5ed65c', '079207f5-33b3-424b-baee-1847b18f5f2d', 'a8da9171-1c64-4097-84e3-ddada085f843', '93490dc0-2381-4e68-a48c-003639c5997e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:20 devstack sudo[102490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:20 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:20 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.331s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Deleted volume successfully.
Sep 29 12:38:20 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0fd0ef95-5578-46bd-91db-1df100b831ee tempest-VolumesGetTest-629353174 None] Lock "cinder-7455ebb8-695a-4dca-8953-d7ef3af20411-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a 1073741824" returned: 0 in 0.529s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:21 devstack sudo[102497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a
Sep 29 12:38:21 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:21 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a" returned: 0 in 0.241s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec822cd-0c36-441a-8250-c12ec8899305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1151a3a0-2f16-4f94-993d-b99d25494b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a (80a05c25-d3c9-42be-ab97-fd1af7d9598a): created successfully
Sep 29 12:38:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1151a3a0-2f16-4f94-993d-b99d25494b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Flow 'volume_create_manager' (cc1f4b97-f658-45de-879d-d52f15c907d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-75a32c29-b681-4ece-a41e-56871f6b63f8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Created volume successfully.
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (5699aac4-8753-480b-9db6-711451c108c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e86ae58-f1b0-44b9-a99f-0ecc0536711a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e86ae58-f1b0-44b9-a99f-0ecc0536711a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2090954399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24aff685-bbef-4b8d-80ff-d9a97fcdff95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:22Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee657a97-ec0b-4ef7-a3a9-13c993473c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee657a97-ec0b-4ef7-a3a9-13c993473c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d765f11c-35b5-4630-bd7d-333668a264e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d765f11c-35b5-4630-bd7d-333668a264e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24aff685-bbef-4b8d-80ff-d9a97fcdff95', 'volume_name': 'volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d8a0b7-19de-4d21-84fd-3c532f63dc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d8a0b7-19de-4d21-84fd-3c532f63dc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177650c8-4d80-4d74-8ed6-b97336296418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:22 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Volume 24aff685-bbef-4b8d-80ff-d9a97fcdff95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95', 'volume_size': 1}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2090954399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24aff685-bbef-4b8d-80ff-d9a97fcdff95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:22Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Creating volume 24aff685-bbef-4b8d-80ff-d9a97fcdff95 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:22 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:22 devstack sudo[102501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 1073741824
Sep 29 12:38:22 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:22 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 1073741824" returned: 0 in 0.568s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:22 devstack sudo[102507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95
Sep 29 12:38:22 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Flow 'volume_create_manager' (f9796bbe-f04e-46c3-a8e3-4553ba8948ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed01def2-c5c7-400c-94e9-cdb593b08751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed01def2-c5c7-400c-94e9-cdb593b08751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1476027294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee74fd4-b3fe-492d-98e7-0ee564f71a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559912ada6493dbdc1367b4c0e9c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:23Z,use_quota=True,user_id='eb59ade950654044b7f1e3d9d727e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c194659-fc04-4b95-8284-e1fc491187bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c194659-fc04-4b95-8284-e1fc491187bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b2ab50-5b4e-4b1e-b579-75ebc4dcf3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b2ab50-5b4e-4b1e-b579-75ebc4dcf3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ee74fd4-b3fe-492d-98e7-0ee564f71a74', 'volume_name': 'volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f0f2f3-bba7-4376-be1e-ce9f9af71296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f0f2f3-bba7-4376-be1e-ce9f9af71296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e233d5a8-6d57-4c42-8658-a56a02c3fabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume 0ee74fd4-b3fe-492d-98e7-0ee564f71a74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74', 'volume_size': 1}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:23 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95" returned: 0 in 0.414s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.115s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1476027294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee74fd4-b3fe-492d-98e7-0ee564f71a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559912ada6493dbdc1367b4c0e9c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:23Z,use_quota=True,user_id='eb59ade950654044b7f1e3d9d727e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Creating volume 0ee74fd4-b3fe-492d-98e7-0ee564f71a74 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:23 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177650c8-4d80-4d74-8ed6-b97336296418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7174f50a-8b4a-4116-9495-1b7d6c20311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:23 devstack sudo[102510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74 1073741824
Sep 29 12:38:23 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Volume volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 (24aff685-bbef-4b8d-80ff-d9a97fcdff95): created successfully
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7174f50a-8b4a-4116-9495-1b7d6c20311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (5699aac4-8753-480b-9db6-711451c108c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-68e9ab70-e3a1-4185-8596-7889959ae011 tempest-VolumesGetTest-629353174 None] Created volume successfully.
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Flow 'volume_create_manager' (8b1d646b-efa7-4628-a5e7-26faf2b57c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1419f2aa-2e80-421f-b069-7d49d4ba57f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1419f2aa-2e80-421f-b069-7d49d4ba57f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400914361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164457dd-ac51-49d8-8da9-04cf2d699fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559912ada6493dbdc1367b4c0e9c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:24Z,use_quota=True,user_id='eb59ade950654044b7f1e3d9d727e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316c17f0-6bb5-4443-a261-abfc6d96324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316c17f0-6bb5-4443-a261-abfc6d96324f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f97abf-9023-4500-9451-1e5de60b8c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f97abf-9023-4500-9451-1e5de60b8c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164457dd-ac51-49d8-8da9-04cf2d699fb0', 'volume_name': 'volume-164457dd-ac51-49d8-8da9-04cf2d699fb0', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe17b31-ef79-4b74-a30c-c45706feafc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe17b31-ef79-4b74-a30c-c45706feafc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1d33b5-6e98-431e-b248-3aa1ec8a00df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume 164457dd-ac51-49d8-8da9-04cf2d699fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164457dd-ac51-49d8-8da9-04cf2d699fb0', 'volume_size': 1}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:23 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74 1073741824" returned: 0 in 0.586s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:23 devstack sudo[102516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74
Sep 29 12:38:23 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Flow 'volume_create_manager' (86f7e1c4-3ea5-449f-b5f6-5e429807614f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a1e5ee-327a-40b7-ba71-30ffa2cc7fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a1e5ee-327a-40b7-ba71-30ffa2cc7fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1318472181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559912ada6493dbdc1367b4c0e9c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:24Z,use_quota=True,user_id='eb59ade950654044b7f1e3d9d727e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bc606e-2302-4980-9101-059d2c8e2133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bc606e-2302-4980-9101-059d2c8e2133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92febda-509b-44e8-836c-a0728a1ac4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92febda-509b-44e8-836c-a0728a1ac4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d', 'volume_name': 'volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e436acdf-caaa-4572-a672-a9899b51e5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e436acdf-caaa-4572-a672-a9899b51e5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9001d2-d8a8-4c77-99fd-01ab28b8745b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume 57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d', 'volume_size': 1}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:24 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74" returned: 0 in 0.338s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.582s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400914361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164457dd-ac51-49d8-8da9-04cf2d699fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559912ada6493dbdc1367b4c0e9c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:24Z,use_quota=True,user_id='eb59ade950654044b7f1e3d9d727e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Creating volume 164457dd-ac51-49d8-8da9-04cf2d699fb0 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:24 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164457dd-ac51-49d8-8da9-04cf2d699fb0 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e233d5a8-6d57-4c42-8658-a56a02c3fabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22bc44e0-df81-4f18-b189-e65bb78a2f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:24 devstack sudo[102519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164457dd-ac51-49d8-8da9-04cf2d699fb0 1073741824
Sep 29 12:38:24 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74 (0ee74fd4-b3fe-492d-98e7-0ee564f71a74): created successfully
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22bc44e0-df81-4f18-b189-e65bb78a2f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Flow 'volume_create_manager' (f9796bbe-f04e-46c3-a8e3-4553ba8948ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fb46a263-42d3-4348-8549-648741e354d3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Created volume successfully.
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Flow 'volume_create_manager' (8d44bb7a-ff58-4f62-bdb1-ab1f9114ced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e8726b-e95d-4957-91f0-ba4250b529d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e8726b-e95d-4957-91f0-ba4250b529d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2045587107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab48c9c5-b3df-405d-a8c1-3a539996a5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559912ada6493dbdc1367b4c0e9c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:24Z,use_quota=True,user_id='eb59ade950654044b7f1e3d9d727e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391b81d4-0eff-41db-9400-0704a392687f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391b81d4-0eff-41db-9400-0704a392687f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07eaced-d0b5-443e-80d5-49591cfdfb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07eaced-d0b5-443e-80d5-49591cfdfb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab48c9c5-b3df-405d-a8c1-3a539996a5db', 'volume_name': 'volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7fd7f9-1dc8-42ac-b589-2c0277f2c419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7fd7f9-1dc8-42ac-b589-2c0277f2c419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb99540-0489-4ebe-ab3b-8d63f3e053ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume ab48c9c5-b3df-405d-a8c1-3a539996a5db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db', 'volume_size': 1}
Sep 29 12:38:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:25 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164457dd-ac51-49d8-8da9-04cf2d699fb0 1073741824" returned: 0 in 0.827s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164457dd-ac51-49d8-8da9-04cf2d699fb0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:25 devstack sudo[102526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164457dd-ac51-49d8-8da9-04cf2d699fb0
Sep 29 12:38:25 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (81558647-d863-47be-a89d-14b477367553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82694e70-ed34-48cc-9287-0b6f7a52035b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Flow 'volume_create_manager' (fcaa842c-36a4-4f68-b1b4-f2ea679fe08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8a7d78-e61c-4b05-a6b2-8e272b660865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:25 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82694e70-ed34-48cc-9287-0b6f7a52035b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-461559382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92866f23-0eb7-4267-9306-6fc757848863,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=24aff685-bbef-4b8d-80ff-d9a97fcdff95,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:25Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85d5e3b-e87d-402b-9381-d8dbd33aa8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85d5e3b-e87d-402b-9381-d8dbd33aa8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297d37df-2676-4e16-93cd-70da7a0ceb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8a7d78-e61c-4b05-a6b2-8e272b660865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-708423071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458e91db-806d-4509-845b-a5e0733b9375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559912ada6493dbdc1367b4c0e9c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:25Z,use_quota=True,user_id='eb59ade950654044b7f1e3d9d727e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d840d6a2-c2b2-48f2-8671-8de13b4a1a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d840d6a2-c2b2-48f2-8671-8de13b4a1a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d30bb7-ae67-4670-a2aa-d4c442c608f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d30bb7-ae67-4670-a2aa-d4c442c608f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '458e91db-806d-4509-845b-a5e0733b9375', 'volume_name': 'volume-458e91db-806d-4509-845b-a5e0733b9375', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1878a0-0135-4aeb-8350-86fb6964f6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1878a0-0135-4aeb-8350-86fb6964f6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a898854f-c6e9-4121-b9ee-d4e1778847ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume 458e91db-806d-4509-845b-a5e0733b9375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-458e91db-806d-4509-845b-a5e0733b9375', 'volume_size': 1}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164457dd-ac51-49d8-8da9-04cf2d699fb0" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.519s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1318472181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559912ada6493dbdc1367b4c0e9c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:24Z,use_quota=True,user_id='eb59ade950654044b7f1e3d9d727e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Creating volume 57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:25 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297d37df-2676-4e16-93cd-70da7a0ceb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '92866f23-0eb7-4267-9306-6fc757848863', 'volume_name': 'volume-92866f23-0eb7-4267-9306-6fc757848863', 'volume_size': 1, 'source_volid': '24aff685-bbef-4b8d-80ff-d9a97fcdff95', 'source_volstatus': 'available'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1736ff93-9507-4381-b6ed-71cf1b3d1d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:25 devstack sudo[102529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d 1073741824
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1736ff93-9507-4381-b6ed-71cf1b3d1d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:25 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95010958-7ff5-4977-b745-1f0fbbd8c440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Volume 92866f23-0eb7-4267-9306-6fc757848863: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-92866f23-0eb7-4267-9306-6fc757848863', 'volume_size': 1, 'source_volid': '24aff685-bbef-4b8d-80ff-d9a97fcdff95', 'source_volstatus': 'available'}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1d33b5-6e98-431e-b248-3aa1ec8a00df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164457dd-ac51-49d8-8da9-04cf2d699fb0', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e028e8ea-3ba9-4668-9cb9-880ca7661778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:25 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume volume-164457dd-ac51-49d8-8da9-04cf2d699fb0 (164457dd-ac51-49d8-8da9-04cf2d699fb0): created successfully
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e028e8ea-3ba9-4668-9cb9-880ca7661778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:25 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Flow 'volume_create_manager' (8b1d646b-efa7-4628-a5e7-26faf2b57c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-04203445-3a05-46c9-92ae-04c692b46e3d tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Created volume successfully.
Sep 29 12:38:26 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d 1073741824" returned: 0 in 0.569s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:26 devstack sudo[102536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d
Sep 29 12:38:26 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:26 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d" returned: 0 in 0.268s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.885s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2045587107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab48c9c5-b3df-405d-a8c1-3a539996a5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559912ada6493dbdc1367b4c0e9c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:24Z,use_quota=True,user_id='eb59ade950654044b7f1e3d9d727e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Creating volume ab48c9c5-b3df-405d-a8c1-3a539996a5db {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:26 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:26 devstack sudo[102539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db 1073741824
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9001d2-d8a8-4c77-99fd-01ab28b8745b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:26 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2d320b-cf76-4f89-b919-ca28c15ca3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d (57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d): created successfully
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2d320b-cf76-4f89-b919-ca28c15ca3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Flow 'volume_create_manager' (86f7e1c4-3ea5-449f-b5f6-5e429807614f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-feb9cbf6-766f-4cbb-999e-867b2106e5d7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Created volume successfully.
Sep 29 12:38:27 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db 1073741824" returned: 0 in 0.495s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:27 devstack sudo[102545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db
Sep 29 12:38:27 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:27 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db" returned: 0 in 0.244s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.700s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-708423071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458e91db-806d-4509-845b-a5e0733b9375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559912ada6493dbdc1367b4c0e9c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:25Z,use_quota=True,user_id='eb59ade950654044b7f1e3d9d727e139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Creating volume 458e91db-806d-4509-845b-a5e0733b9375 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:27 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-458e91db-806d-4509-845b-a5e0733b9375 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb99540-0489-4ebe-ab3b-8d63f3e053ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:27 devstack sudo[102548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-458e91db-806d-4509-845b-a5e0733b9375 1073741824
Sep 29 12:38:27 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae304316-b5a2-4769-8385-635fb5d9d8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:27 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db (ab48c9c5-b3df-405d-a8c1-3a539996a5db): created successfully
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae304316-b5a2-4769-8385-635fb5d9d8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Flow 'volume_create_manager' (8d44bb7a-ff58-4f62-bdb1-ab1f9114ced3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-74c11f02-e914-40b8-b95a-37aaaeacf3c4 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Created volume successfully.
Sep 29 12:38:27 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-458e91db-806d-4509-845b-a5e0733b9375 1073741824" returned: 0 in 0.501s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-458e91db-806d-4509-845b-a5e0733b9375 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:27 devstack sudo[102555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-458e91db-806d-4509-845b-a5e0733b9375
Sep 29 12:38:27 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:28 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-458e91db-806d-4509-845b-a5e0733b9375" returned: 0 in 0.257s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.398s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:28 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Cloning volume 24aff685-bbef-4b8d-80ff-d9a97fcdff95 to volume 92866f23-0eb7-4267-9306-6fc757848863
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a898854f-c6e9-4121-b9ee-d4e1778847ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-458e91db-806d-4509-845b-a5e0733b9375', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d5fc06-aa3e-4f14-97f6-02af5920ce7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:28 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Volume volume-458e91db-806d-4509-845b-a5e0733b9375 (458e91db-806d-4509-845b-a5e0733b9375): created successfully
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d5fc06-aa3e-4f14-97f6-02af5920ce7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Flow 'volume_create_manager' (fcaa842c-36a4-4f68-b1b4-f2ea679fe08e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Creating offline snapshot 3dfed3b7-4a52-4a2b-bf39-72f494a54e10 of volume 24aff685-bbef-4b8d-80ff-d9a97fcdff95 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:38:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-962f9a7c-ea9d-48f6-9294-b84a96d1f1e1 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Created volume successfully.
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b80537-344c-42af-9c14-a8f0e5dab6be]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:28 devstack sudo[102558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95
Sep 29 12:38:28 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:28 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95" returned: 0 in 0.413s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "cinder-458e91db-806d-4509-845b-a5e0733b9375-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-458e91db-806d-4509-845b-a5e0733b9375-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:28 devstack sudo[102563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10 1G
Sep 29 12:38:28 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "cinder-quobyte-458e91db-806d-4509-845b-a5e0733b9375" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-quobyte-458e91db-806d-4509-845b-a5e0733b9375" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa8e16c-f9b1-4e3b-9894-f1f2bd6ba27c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-458e91db-806d-4509-845b-a5e0733b9375 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:28 devstack sudo[102565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-458e91db-806d-4509-845b-a5e0733b9375
Sep 29 12:38:28 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:29 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10 1G" returned: 0 in 0.560s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:29 devstack sudo[102573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10
Sep 29 12:38:29 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:29 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-458e91db-806d-4509-845b-a5e0733b9375" returned: 0 in 0.425s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-458e91db-806d-4509-845b-a5e0733b9375 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:29 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-458e91db-806d-4509-845b-a5e0733b9375
Sep 29 12:38:29 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:29 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10" returned: 0 in 0.349s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:29 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10 is being set with open permissions: ugo+rw
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:29 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-458e91db-806d-4509-845b-a5e0733b9375" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:29 devstack sudo[102581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10
Sep 29 12:38:29 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-quobyte-458e91db-806d-4509-845b-a5e0733b9375" released by "delete_volume" :: held 0.800s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Created reservations ['7a2a2d23-8d7c-4264-af06-f1746e961c1a', '7031e531-3dca-4053-aabe-2d18e04911f6', '3aea0182-02f8-43ed-8ccb-6ffebbc88c2b', '661b714b-ab90-4c96-818b-b45abd7d4fe5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:29 devstack sudo[102583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:29 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:29 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10" returned: 0 in 0.267s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "cinder-ab48c9c5-b3df-405d-a8c1-3a539996a5db-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:29 devstack sudo[102586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.info
Sep 29 12:38:29 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-ab48c9c5-b3df-405d-a8c1-3a539996a5db-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "cinder-quobyte-ab48c9c5-b3df-405d-a8c1-3a539996a5db" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-quobyte-ab48c9c5-b3df-405d-a8c1-3a539996a5db" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[43188ab3-ea1f-41fe-85fa-13ec99b8f9e0]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:30 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.289s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:30 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Deleted volume successfully.
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea4dae75-4a64-4223-bc0f-18469c563340 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-458e91db-806d-4509-845b-a5e0733b9375-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:30 devstack sudo[102589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db
Sep 29 12:38:30 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:30 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.info" returned: 0 in 0.334s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:30 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.info is being set with open permissions: ugo+rw
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:30 devstack sudo[102592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.info
Sep 29 12:38:30 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:30 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.info" returned: 0 in 0.335s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:30 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-quobyte-92866f23-0eb7-4267-9306-6fc757848863" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db" returned: 0 in 0.529s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-92866f23-0eb7-4267-9306-6fc757848863" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] snapshot: 3dfed3b7-4a52-4a2b-bf39-72f494a54e10, volume: 92866f23-0eb7-4267-9306-6fc757848863,  {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 12:38:30 devstack sudo[102598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db
Sep 29 12:38:30 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91773b0-add7-4824-87ca-a770c8117bd5]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:30 devstack sudo[102600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10
Sep 29 12:38:30 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:30 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ab48c9c5-b3df-405d-a8c1-3a539996a5db" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-quobyte-ab48c9c5-b3df-405d-a8c1-3a539996a5db" released by "delete_volume" :: held 0.872s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Created reservations ['1e40d83a-b125-49ba-89e6-f49fc7ed27ba', '4ff03c3e-fdff-4523-9119-1afa86994c52', 'c97cd509-113a-47c5-bf96-4e3cbe2054a4', '1217a723-af1a-4535-8f01-2fa5824b8162'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:31 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10" returned: 0 in 0.433s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:38:31 devstack sudo[102606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:31 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a95bafb-4017-4b98-821e-08e0059424d1]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "cinder-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "cinder-quobyte-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:31 devstack sudo[102608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95
Sep 29 12:38:31 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-quobyte-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d846cf6d-f76c-4c12-ae2b-b870523add2a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:31 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Deleted volume successfully.
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-668acc0d-c4c4-4f21-9523-cf2f3a6b9e0e tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-ab48c9c5-b3df-405d-a8c1-3a539996a5db-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:31 devstack sudo[102610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d
Sep 29 12:38:31 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:31 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95" returned: 0 in 0.499s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Path /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:31 devstack sudo[102617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863
Sep 29 12:38:31 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:31 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d" returned: 0 in 0.513s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:31 devstack sudo[102622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d
Sep 29 12:38:31 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:32 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d" returned: 0 in 0.301s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-quobyte-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d" released by "delete_volume" :: held 0.894s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Created reservations ['e2fa05fb-e129-40e0-9154-141ed85076e7', 'a0be1486-3d58-48a5-8ada-79417b70b36b', '0e62c872-a9f9-4033-9e23-03f0a07c0727', '0231f375-4a21-4421-8dac-2c70feed12f1'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:32 devstack sudo[102635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:32 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "cinder-164457dd-ac51-49d8-8da9-04cf2d699fb0-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-164457dd-ac51-49d8-8da9-04cf2d699fb0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "cinder-quobyte-164457dd-ac51-49d8-8da9-04cf2d699fb0" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-quobyte-164457dd-ac51-49d8-8da9-04cf2d699fb0" acquired by "delete_volume" :: waited 0.041s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e806473-1ed5-417e-8f2b-7310a99f084e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164457dd-ac51-49d8-8da9-04cf2d699fb0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:32 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.615s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:32 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:33 devstack sudo[102637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164457dd-ac51-49d8-8da9-04cf2d699fb0
Sep 29 12:38:33 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Deleted volume successfully.
Sep 29 12:38:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3701ecb3-bac8-4d94-84a4-805fa4c7a4ad tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-57cac5e5-f5a1-49f0-adbc-dd3f0f338b1d-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:33 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164457dd-ac51-49d8-8da9-04cf2d699fb0" returned: 0 in 0.786s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164457dd-ac51-49d8-8da9-04cf2d699fb0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:33 devstack sudo[102643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164457dd-ac51-49d8-8da9-04cf2d699fb0
Sep 29 12:38:33 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:34 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-164457dd-ac51-49d8-8da9-04cf2d699fb0" returned: 0 in 0.714s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-quobyte-164457dd-ac51-49d8-8da9-04cf2d699fb0" released by "delete_volume" :: held 1.609s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:34 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=216,cinder:SELECT=161,cinder:INSERT=53,cinder:DELETE=19 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:38:34 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=165,cinder:UPDATE=217,cinder:INSERT=54,cinder:DELETE=19 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:38:34 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Created reservations ['5b5fd28f-3944-4a24-960b-cca057097a3a', '25ad1b2d-d25f-48a4-9106-e20f77ca3598', 'be2a50d0-2998-4bc9-8675-083c86760301', 'eb769bb2-b0db-49b3-9301-29901ea766d1'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:34 devstack sudo[102647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:34 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "cinder-0ee74fd4-b3fe-492d-98e7-0ee564f71a74-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-0ee74fd4-b3fe-492d-98e7-0ee564f71a74-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:35 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "cinder-quobyte-0ee74fd4-b3fe-492d-98e7-0ee564f71a74" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.698s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:35 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Deleted volume successfully.
Sep 29 12:38:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-quobyte-0ee74fd4-b3fe-492d-98e7-0ee564f71a74" acquired by "delete_volume" :: waited 0.045s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b651bb0f-949c-413e-a9f4-07d29ebd8fb3 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-164457dd-ac51-49d8-8da9-04cf2d699fb0-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0c52d9-2b4e-477f-973c-6a07be667cc6]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:35 devstack sudo[102651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74
Sep 29 12:38:35 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:36 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74" returned: 0 in 0.735s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:36 devstack sudo[102657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74
Sep 29 12:38:36 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:36 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0ee74fd4-b3fe-492d-98e7-0ee564f71a74" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-quobyte-0ee74fd4-b3fe-492d-98e7-0ee564f71a74" released by "delete_volume" :: held 1.291s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:36 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Created reservations ['3c81aecb-ae14-4b24-9f5f-47e35e8bb3d6', 'ae0d26c1-410f-4c18-bd06-1431e7bf2930', '2ef1a936-940f-446f-bb12-f9549b0aa302', '77fbb979-a96e-4c51-b697-5cc84f346859'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:36 devstack sudo[102660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:36 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:37 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.385s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:37 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Deleted volume successfully.
Sep 29 12:38:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d79f5f74-5033-4a17-a490-f86b95bfddb8 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-0ee74fd4-b3fe-492d-98e7-0ee564f71a74-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "cinder-80a05c25-d3c9-42be-ab97-fd1af7d9598a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-80a05c25-d3c9-42be-ab97-fd1af7d9598a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "cinder-quobyte-80a05c25-d3c9-42be-ab97-fd1af7d9598a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-quobyte-80a05c25-d3c9-42be-ab97-fd1af7d9598a" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:37 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfaeb0d-a400-439b-981c-bc4a2cbc0685]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:37 devstack sudo[102663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a
Sep 29 12:38:37 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:38 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a" returned: 0 in 0.672s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:38 devstack sudo[102668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a
Sep 29 12:38:38 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:38 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-80a05c25-d3c9-42be-ab97-fd1af7d9598a" returned: 0 in 0.364s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-quobyte-80a05c25-d3c9-42be-ab97-fd1af7d9598a" released by "delete_volume" :: held 1.143s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Created reservations ['ec2df995-f371-47e6-990e-c7f62a435204', '717214c8-265f-48dd-b37e-171f0ffa650f', 'e0feb0b5-9875-43d8-8f32-a244d060b27f', '2f41cdd6-7c05-4e71-8dd6-628728111102'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:39 devstack sudo[102671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:39 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:39 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.435s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Deleted volume successfully.
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-cbe5d6fd-733d-4fb6-9da1-9101377b06e7 tempest-CreateVolumesFromSourceVolumeTest-916231353 None] Lock "cinder-80a05c25-d3c9-42be-ab97-fd1af7d9598a-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:39 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863" returned: 0 in 8.309s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95, size 1024.00 MB, duration 8.31 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:38:39 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Converted 1024.00 MB image at 123.22 MB/s
Sep 29 12:38:39 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863 is being set with open permissions: ugo+rw
Sep 29 12:38:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:39 devstack sudo[102674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863
Sep 29 12:38:39 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:40 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863" returned: 0 in 0.270s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-92866f23-0eb7-4267-9306-6fc757848863" released by "_copy_volume_from_snapshot" :: held 9.613s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-quobyte-3dfed3b7-4a52-4a2b-bf39-72f494a54e10" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-3dfed3b7-4a52-4a2b-bf39-72f494a54e10" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Deleting offline snapshot 3dfed3b7-4a52-4a2b-bf39-72f494a54e10 of volume 24aff685-bbef-4b8d-80ff-d9a97fcdff95 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:38:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] snapshot_file for this snap is: volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:38:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8548c075-963a-4e13-9c78-5350321a4374]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:40 devstack sudo[102677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10
Sep 29 12:38:40 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:40 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10" returned: 0 in 0.422s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:38:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0f2bb2-1953-4a9c-aab0-2d79f0eb633b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:40 devstack sudo[102682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95
Sep 29 12:38:40 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:41 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95" returned: 0 in 0.631s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:41 devstack sudo[102687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10
Sep 29 12:38:41 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:41 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10" returned: 0 in 0.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:41 devstack sudo[102693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10
Sep 29 12:38:41 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:42 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95.3dfed3b7-4a52-4a2b-bf39-72f494a54e10" returned: 0 in 0.304s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-3dfed3b7-4a52-4a2b-bf39-72f494a54e10" released by "_delete_snapshot" :: held 1.895s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.063s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95010958-7ff5-4977-b745-1f0fbbd8c440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92866f23-0eb7-4267-9306-6fc757848863', 'volume_size': 1, 'source_volid': '24aff685-bbef-4b8d-80ff-d9a97fcdff95', 'source_volstatus': 'available'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6a4ad5-23c3-4a21-93dd-1a4665af8137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:42 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Volume volume-92866f23-0eb7-4267-9306-6fc757848863 (92866f23-0eb7-4267-9306-6fc757848863): created successfully
Sep 29 12:38:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6a4ad5-23c3-4a21-93dd-1a4665af8137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (81558647-d863-47be-a89d-14b477367553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f09dd9b1-a904-4c50-a4b2-116177b04c2a tempest-VolumesGetTest-629353174 None] Created volume successfully.
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Flow 'volume_create_manager' (ba58680b-6fb5-44bc-a694-6b12c07e0ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5022d4c-111b-467a-a8e9-4fe9e293a1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5022d4c-111b-467a-a8e9-4fe9e293a1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-999057437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ee36a8-5073-45f4-bab3-0ea7a37caf70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c50e14aca854e7285a9f4096e1f2a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:43Z,use_quota=True,user_id='3c7419c38af14dfda8565a1134640a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85aa4a56-f805-4798-8812-bac04116aff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85aa4a56-f805-4798-8812-bac04116aff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dddc25b7-e434-4eb1-b30a-3c7d7ec1118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dddc25b7-e434-4eb1-b30a-3c7d7ec1118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25ee36a8-5073-45f4-bab3-0ea7a37caf70', 'volume_name': 'volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbaf485-93c1-400b-9b43-1182b27bc798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbaf485-93c1-400b-9b43-1182b27bc798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c75485-dfcd-442c-b699-f05a4b9875ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:43 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Volume 25ee36a8-5073-45f4-bab3-0ea7a37caf70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70', 'volume_size': 1}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-999057437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ee36a8-5073-45f4-bab3-0ea7a37caf70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c50e14aca854e7285a9f4096e1f2a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:43Z,use_quota=True,user_id='3c7419c38af14dfda8565a1134640a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Creating volume 25ee36a8-5073-45f4-bab3-0ea7a37caf70 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:43 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:43 devstack sudo[102696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 1073741824
Sep 29 12:38:43 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (415c8d96-d2f9-4ba5-83ca-b6f1009cff25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c45ab3-03bc-4ef2-92a8-2995adc11f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c45ab3-03bc-4ef2-92a8-2995adc11f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-465453506',display_name='tempest-VolumesGetTest-Volume-1985333433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b624368-dbe4-4602-9fc4-936ef531a3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:44Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc72ccb-53c8-4910-882a-0c183e6946fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc72ccb-53c8-4910-882a-0c183e6946fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88f34dd-7ca1-4647-990c-8beab0071f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88f34dd-7ca1-4647-990c-8beab0071f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b624368-dbe4-4602-9fc4-936ef531a3f8', 'volume_name': 'volume-6b624368-dbe4-4602-9fc4-936ef531a3f8', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d6ff61-968d-443a-89f6-f61e57847f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d6ff61-968d-443a-89f6-f61e57847f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114c37a2-8624-4c06-939a-c1caa31db25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:43 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Volume 6b624368-dbe4-4602-9fc4-936ef531a3f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b624368-dbe4-4602-9fc4-936ef531a3f8', 'volume_size': 1}
Sep 29 12:38:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:44 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 1073741824" returned: 0 in 0.699s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:44 devstack sudo[102701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70
Sep 29 12:38:44 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:44 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70" returned: 0 in 0.252s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-465453506',display_name='tempest-VolumesGetTest-Volume-1985333433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b624368-dbe4-4602-9fc4-936ef531a3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:44Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Creating volume 6b624368-dbe4-4602-9fc4-936ef531a3f8 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:44 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6b624368-dbe4-4602-9fc4-936ef531a3f8 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c75485-dfcd-442c-b699-f05a4b9875ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:44 devstack sudo[102704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6b624368-dbe4-4602-9fc4-936ef531a3f8 1073741824
Sep 29 12:38:44 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6573eeb4-1a55-4ccf-9440-044b49dc9cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:44 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Volume volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 (25ee36a8-5073-45f4-bab3-0ea7a37caf70): created successfully
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6573eeb4-1a55-4ccf-9440-044b49dc9cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Flow 'volume_create_manager' (ba58680b-6fb5-44bc-a694-6b12c07e0ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-eb514ee4-05ca-4dfb-a7cb-5cbd6fcff55f tempest-VolumeDependencyTests-991151103 None] Created volume successfully.
Sep 29 12:38:44 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6b624368-dbe4-4602-9fc4-936ef531a3f8 1073741824" returned: 0 in 0.515s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6b624368-dbe4-4602-9fc4-936ef531a3f8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:44 devstack sudo[102711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6b624368-dbe4-4602-9fc4-936ef531a3f8
Sep 29 12:38:44 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:45 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6b624368-dbe4-4602-9fc4-936ef531a3f8" returned: 0 in 0.312s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114c37a2-8624-4c06-939a-c1caa31db25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b624368-dbe4-4602-9fc4-936ef531a3f8', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a69d10-e485-467f-b24d-86f7d9f4d95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:45 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Volume volume-6b624368-dbe4-4602-9fc4-936ef531a3f8 (6b624368-dbe4-4602-9fc4-936ef531a3f8): created successfully
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a69d10-e485-467f-b24d-86f7d9f4d95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (415c8d96-d2f9-4ba5-83ca-b6f1009cff25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:45 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a6bf98cf-36c0-4fcf-8359-ccf97e32dc57 tempest-VolumesGetTest-629353174 None] Created volume successfully.
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] Creating offline snapshot 18cf096f-ca16-4227-b564-648b7d8f4d4f of volume 25ee36a8-5073-45f4-bab3-0ea7a37caf70 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85fb449-1c72-4e03-9a9b-800494f1ca34]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:45 devstack sudo[102714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70
Sep 29 12:38:45 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:45 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70" returned: 0 in 0.449s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:46 devstack sudo[102719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f 1G
Sep 29 12:38:46 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-6b624368-dbe4-4602-9fc4-936ef531a3f8-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Lock "cinder-6b624368-dbe4-4602-9fc4-936ef531a3f8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-quobyte-6b624368-dbe4-4602-9fc4-936ef531a3f8" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-6b624368-dbe4-4602-9fc4-936ef531a3f8" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:46 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4773e8bd-18be-4b70-b344-6e93068e52f7]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6b624368-dbe4-4602-9fc4-936ef531a3f8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:46 devstack sudo[102723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6b624368-dbe4-4602-9fc4-936ef531a3f8
Sep 29 12:38:46 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:46 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f 1G" returned: 0 in 0.514s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:46 devstack sudo[102726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f
Sep 29 12:38:46 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:46 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6b624368-dbe4-4602-9fc4-936ef531a3f8" returned: 0 in 0.477s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6b624368-dbe4-4602-9fc4-936ef531a3f8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:46 devstack sudo[102731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6b624368-dbe4-4602-9fc4-936ef531a3f8
Sep 29 12:38:46 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:46 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f" returned: 0 in 0.394s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:46 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f is being set with open permissions: ugo+rw
Sep 29 12:38:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:46 devstack sudo[102736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f
Sep 29 12:38:46 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:47 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6b624368-dbe4-4602-9fc4-936ef531a3f8" returned: 0 in 0.327s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-6b624368-dbe4-4602-9fc4-936ef531a3f8" released by "delete_volume" :: held 0.873s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Created reservations ['7264457f-0e04-49d1-acc6-d2fa1fe1ecfa', '9c24e7c7-b76b-43f2-b6ff-f13bcaafd223', '9a7c4568-6ae6-4443-a77d-5504d34ddff8', 'eef03b05-3f3d-4b84-8768-2afda2d5ecb9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:47 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f" returned: 0 in 0.284s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:47 devstack sudo[102740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:47 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:47 devstack sudo[102742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.info
Sep 29 12:38:47 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-92866f23-0eb7-4267-9306-6fc757848863-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Lock "cinder-92866f23-0eb7-4267-9306-6fc757848863-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-quobyte-92866f23-0eb7-4267-9306-6fc757848863" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-92866f23-0eb7-4267-9306-6fc757848863" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[936a98c4-c5dd-4969-a8ad-0457206953a1]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:47 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Deleted volume successfully.
Sep 29 12:38:47 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.info" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:47 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.info is being set with open permissions: ugo+rw
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:47 devstack sudo[102744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863
Sep 29 12:38:47 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bf3109e6-2ec1-4b31-943e-e48181d80125 tempest-VolumesGetTest-629353174 None] Lock "cinder-6b624368-dbe4-4602-9fc4-936ef531a3f8-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:47 devstack sudo[102747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.info
Sep 29 12:38:47 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:47 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:47 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863" returned: 0 in 0.466s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.info" returned: 0 in 0.327s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:47 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863
Sep 29 12:38:47 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5a042087-37dc-4dc6-9abd-3705feae8986 tempest-VolumeDependencyTests-991151103 None] Create snapshot completed successfully
Sep 29 12:38:48 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-92866f23-0eb7-4267-9306-6fc757848863" returned: 0 in 0.263s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-92866f23-0eb7-4267-9306-6fc757848863" released by "delete_volume" :: held 0.793s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Created reservations ['37e01fb1-e553-4939-ab72-54fa272ef5f4', '38753998-d627-4fb7-911e-9c370b4e7748', '64ddc85b-48a6-491a-8ec0-c75fe8366869', '632e0bf8-6d3b-4769-9359-81656f9a60f5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:48 devstack sudo[102757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:48 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-24aff685-bbef-4b8d-80ff-d9a97fcdff95-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Lock "cinder-24aff685-bbef-4b8d-80ff-d9a97fcdff95-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:48 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.297s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Deleted volume successfully.
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0e533de9-a993-4c34-9a5f-0ad67a9e235b tempest-VolumesGetTest-629353174 None] Lock "cinder-92866f23-0eb7-4267-9306-6fc757848863-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-quobyte-24aff685-bbef-4b8d-80ff-d9a97fcdff95" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-24aff685-bbef-4b8d-80ff-d9a97fcdff95" acquired by "delete_volume" :: waited 0.036s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c56dc1a-85a2-406a-8090-f6ab67db009d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:49 devstack sudo[102760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95
Sep 29 12:38:49 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:49 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95" returned: 0 in 0.496s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:49 devstack sudo[102766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95
Sep 29 12:38:49 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Flow 'volume_create_manager' (67e65f7e-6f3e-40a5-977b-6623259ba3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5768e8-ed91-4373-a300-900f6d97e296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5768e8-ed91-4373-a300-900f6d97e296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-73320637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c50e14aca854e7285a9f4096e1f2a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=18cf096f-ca16-4227-b564-648b7d8f4d4f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:49Z,use_quota=True,user_id='3c7419c38af14dfda8565a1134640a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b390d3ce-131b-4c6c-882f-a5d7622f5c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b390d3ce-131b-4c6c-882f-a5d7622f5c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c63bbfd-0717-4fa8-b7d2-ff41881c9f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c63bbfd-0717-4fa8-b7d2-ff41881c9f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca', 'volume_name': 'volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca', 'volume_size': 1, 'snapshot_id': '18cf096f-ca16-4227-b564-648b7d8f4d4f'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc2153d-2155-4a24-8eba-dce744bc1d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc2153d-2155-4a24-8eba-dce744bc1d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4122f5f1-2af1-4b50-a494-88f5c39b97bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Volume 49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca', 'volume_size': 1, 'snapshot_id': '18cf096f-ca16-4227-b564-648b7d8f4d4f'}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Acquiring lock "cinder-quobyte-18cf096f-ca16-4227-b564-648b7d8f4d4f-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Lock "cinder-quobyte-18cf096f-ca16-4227-b564-648b7d8f4d4f-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Creating volume 49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca from snapshot 18cf096f-ca16-4227-b564-648b7d8f4d4f {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:49 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Acquiring lock "cinder-quobyte-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24aff685-bbef-4b8d-80ff-d9a97fcdff95" returned: 0 in 0.363s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-24aff685-bbef-4b8d-80ff-d9a97fcdff95" released by "delete_volume" :: held 1.030s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Lock "cinder-quobyte-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" acquired by "_copy_volume_from_snapshot" :: waited 0.085s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] snapshot: 18cf096f-ca16-4227-b564-648b7d8f4d4f, volume: 49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca,  {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f456acc8-5a80-4321-aec3-142cc44bbdbc]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:49 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Created reservations ['11cca48d-a497-4c43-9434-e8d9a0e55b1d', '2959d428-1b77-41ee-b4ce-9391fa8c0951', '59cc651f-88b2-44bf-8fc4-725a765b7ed5', '5a7c3fdb-7838-407f-bc28-23470307d2a5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:38:50 devstack sudo[102769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f
Sep 29 12:38:50 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:50 devstack sudo[102771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:38:50 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:50 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:38:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Deleted volume successfully.
Sep 29 12:38:50 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f" returned: 0 in 0.493s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-72400c5a-a826-4b41-9173-30d15b30682b tempest-VolumesGetTest-629353174 None] Lock "cinder-24aff685-bbef-4b8d-80ff-d9a97fcdff95-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1d4ad8-b3ed-49c9-a86e-568a89b786af]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:50 devstack sudo[102777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70
Sep 29 12:38:50 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:50 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70" returned: 0 in 0.403s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Path /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 12:38:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:50 devstack sudo[102782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca
Sep 29 12:38:50 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:52 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:38:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (7fff7a9e-3dd0-44ab-8992-237fa6e1e3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42762998-5cc9-4656-9291-1226bfdab8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42762998-5cc9-4656-9291-1226bfdab8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-57948278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0abe8d-d869-438b-9032-f19366e3eb95,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:52Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb71293-8687-4eac-bec3-b74a74281171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb71293-8687-4eac-bec3-b74a74281171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371b2102-8e5a-4b09-a74d-1924ab96daf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:52 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 12:38:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371b2102-8e5a-4b09-a74d-1924ab96daf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b0abe8d-d869-438b-9032-f19366e3eb95', 'volume_name': 'volume-0b0abe8d-d869-438b-9032-f19366e3eb95', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701afd6c00>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48929b43-b89b-4134-89f8-406ec3440f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48929b43-b89b-4134-89f8-406ec3440f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59db272-c5f4-4f52-b926-82e659d3a8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Volume 0b0abe8d-d869-438b-9032-f19366e3eb95: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b0abe8d-d869-438b-9032-f19366e3eb95', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701afd6c00>}
Sep 29 12:38:53 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Trying to clone 0b0abe8d-d869-438b-9032-f19366e3eb95 from image f8e17489-d113-49d7-ab01-94ac91f04646 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 12:38:53 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 12:38:53 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 12:38:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e6e9f8-8c83-4d1b-b2c9-4b1621f5ebfd]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:54 devstack sudo[102795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD
Sep 29 12:38:54 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:54 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD" returned: 0 in 0.561s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:54 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Temporary image f8e17489-d113-49d7-ab01-94ac91f04646 is fetched for user 4bdbc2a7e01143bc82a0e38baedbc225. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 12:38:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a98a27-3cff-4e46-b6cc-46807f9fa131]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:38:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:55 devstack sudo[102802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD
Sep 29 12:38:55 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:55 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD" returned: 0 in 0.991s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:59 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" returned: 0 in 8.315s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70, size 1024.00 MB, duration 8.32 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:38:59 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Converted 1024.00 MB image at 123.13 MB/s
Sep 29 12:38:59 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca is being set with open permissions: ugo+rw
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:59 devstack sudo[102850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca
Sep 29 12:38:59 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:59 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Lock "cinder-quobyte-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" released by "_copy_volume_from_snapshot" :: held 9.619s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Lock "cinder-quobyte-18cf096f-ca16-4227-b564-648b7d8f4d4f-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" released by "_create_volume_from_snapshot" :: held 9.780s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.800s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.662s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-57948278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0abe8d-d869-438b-9032-f19366e3eb95,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:38:52Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Creating volume 0b0abe8d-d869-438b-9032-f19366e3eb95 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:38:59 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:38:59 devstack sudo[102853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95 1073741824
Sep 29 12:38:59 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4122f5f1-2af1-4b50-a494-88f5c39b97bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca', 'volume_size': 1, 'snapshot_id': '18cf096f-ca16-4227-b564-648b7d8f4d4f'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63da6dce-19af-4cb8-abbf-d3eb75a60264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:38:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Volume volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca (49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca): created successfully
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63da6dce-19af-4cb8-abbf-d3eb75a60264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:38:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Flow 'volume_create_manager' (67e65f7e-6f3e-40a5-977b-6623259ba3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:38:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8d07580a-0b82-4a8b-83ec-af2380ee809b tempest-VolumeDependencyTests-991151103 None] Created volume successfully.
Sep 29 12:39:00 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95 1073741824" returned: 0 in 0.537s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:00 devstack sudo[102859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95
Sep 29 12:39:00 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:00 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95" returned: 0 in 0.258s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Attempting download of f8e17489-d113-49d7-ab01-94ac91f04646 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}])) to volume 0b0abe8d-d869-438b-9032-f19366e3eb95. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25f13b8-2834-404a-9c60-cc3995229c85]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_76ybk31t {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:00 devstack sudo[102862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_76ybk31t
Sep 29 12:39:00 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Acquiring lock "cinder-18cf096f-ca16-4227-b564-648b7d8f4d4f-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Lock "cinder-18cf096f-ca16-4227-b564-648b7d8f4d4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.096s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Acquiring lock "cinder-quobyte-25ee36a8-5073-45f4-bab3-0ea7a37caf70" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Lock "cinder-quobyte-25ee36a8-5073-45f4-bab3-0ea7a37caf70" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Acquiring lock "cinder-quobyte-18cf096f-ca16-4227-b564-648b7d8f4d4f" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Lock "cinder-quobyte-18cf096f-ca16-4227-b564-648b7d8f4d4f" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Deleting offline snapshot 18cf096f-ca16-4227-b564-648b7d8f4d4f of volume 25ee36a8-5073-45f4-bab3-0ea7a37caf70 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:39:00 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] snapshot_file for this snap is: volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_76ybk31t" returned: 0 in 0.435s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_76ybk31t {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3b322d-9a0c-43bb-bd50-6cf0132d61ab]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:01 devstack sudo[102867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f
Sep 29 12:39:01 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:01 devstack sudo[102866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_76ybk31t
Sep 29 12:39:01 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:01 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f" returned: 0 in 0.442s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:01 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:39:01 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_76ybk31t" returned: 1 in 0.496s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8e17489-d113-49d7-ab01-94ac91f04646_76ybk31t' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:39:01 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0376478-b0fd-4350-af2f-fb2445c53d5c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:01 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f293c4-4e3d-4d92-981b-4be92755828d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:01 devstack sudo[102876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD
Sep 29 12:39:01 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:01 devstack sudo[102877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70
Sep 29 12:39:01 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:01 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD" returned: 0 in 0.475s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:01 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] f8e17489-d113-49d7-ab01-94ac91f04646 was qcow2, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 12:39:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:01 devstack sudo[102886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95
Sep 29 12:39:01 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:02 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70" returned: 0 in 0.763s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:02 devstack sudo[102890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f
Sep 29 12:39:02 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:02 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f" returned: 0 in 0.519s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:02 devstack sudo[102902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f
Sep 29 12:39:02 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:03 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70.18cf096f-ca16-4227-b564-648b7d8f4d4f" returned: 0 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Lock "cinder-quobyte-18cf096f-ca16-4227-b564-648b7d8f4d4f" released by "_delete_snapshot" :: held 2.308s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Lock "cinder-quobyte-25ee36a8-5073-45f4-bab3-0ea7a37caf70" released by "delete_snapshot" :: held 2.355s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:03 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Created reservations ['4e1c4f03-11b1-4fe4-9aaa-39223627bf48', '246228a3-c829-4c1d-8321-04a66e9c7ea7', '121d85f6-85a1-4768-a27e-01ca1249b379', 'e8e9a3c5-b478-4eeb-9525-1a3aeaf58a00'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:39:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Delete snapshot completed successfully.
Sep 29 12:39:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-048e32b2-af05-4828-ae5b-4585ac56cc47 tempest-VolumeDependencyTests-991151103 None] Lock "cinder-18cf096f-ca16-4227-b564-648b7d8f4d4f-delete_snapshot" released by "delete_snapshot" :: held 2.565s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Acquiring lock "cinder-25ee36a8-5073-45f4-bab3-0ea7a37caf70-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Lock "cinder-25ee36a8-5073-45f4-bab3-0ea7a37caf70-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Acquiring lock "cinder-quobyte-25ee36a8-5073-45f4-bab3-0ea7a37caf70" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Lock "cinder-quobyte-25ee36a8-5073-45f4-bab3-0ea7a37caf70" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9825e46-3186-4a79-b87c-4ffdf6b5b27e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:04 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95" returned: 0 in 2.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f8e17489-d113-49d7-ab01-94ac91f04646__jphbnp0devstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:39:04 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Converted 112.00 MB image at 47.29 MB/s
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:04 devstack sudo[102906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95 1G
Sep 29 12:39:04 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:04 devstack sudo[102905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70
Sep 29 12:39:04 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:04 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70" returned: 0 in 0.488s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:04 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95 1G" returned: 0 in 0.438s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Downloaded image f8e17489-d113-49d7-ab01-94ac91f04646 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}])) to volume 0b0abe8d-d869-438b-9032-f19366e3eb95 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Temporary image f8e17489-d113-49d7-ab01-94ac91f04646 for user 4bdbc2a7e01143bc82a0e38baedbc225 is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Marking volume 0b0abe8d-d869-438b-9032-f19366e3eb95 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 12:39:04 devstack sudo[102917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70
Sep 29 12:39:04 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Copying metadata from image f8e17489-d113-49d7-ab01-94ac91f04646 to 0b0abe8d-d869-438b-9032-f19366e3eb95. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Creating volume glance metadata for volume 0b0abe8d-d869-438b-9032-f19366e3eb95 backed by image f8e17489-d113-49d7-ab01-94ac91f04646 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59db272-c5f4-4f52-b926-82e659d3a8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0abe8d-d869-438b-9032-f19366e3eb95', 'volume_size': 1, 'image_id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8e17489-d113-49d7-ab01-94ac91f04646', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a14da5f02949ea9888789aa6679ea3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f8e17489-d113-49d7-ab01-94ac91f04646', 'created_at': datetime.datetime(2026, 9, 29, 10, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8e17489-d113-49d7-ab01-94ac91f04646/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701afd6c00>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf706541-b77f-4b20-b887-88f9743e59ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Volume volume-0b0abe8d-d869-438b-9032-f19366e3eb95 (0b0abe8d-d869-438b-9032-f19366e3eb95): created successfully
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf706541-b77f-4b20-b887-88f9743e59ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (7fff7a9e-3dd0-44ab-8992-237fa6e1e3f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bbd0a1c0-488a-44e0-8a07-c3720066f6e8 tempest-VolumesGetTest-629353174 None] Created volume successfully.
Sep 29 12:39:05 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-25ee36a8-5073-45f4-bab3-0ea7a37caf70" returned: 0 in 0.364s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Lock "cinder-quobyte-25ee36a8-5073-45f4-bab3-0ea7a37caf70" released by "delete_volume" :: held 0.974s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:05 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Created reservations ['c50720c9-c4b1-4192-a164-db020f2c6f67', 'e1cfb99c-9626-462a-a439-e7bed99700fa', '6cc57236-a454-4f40-b96e-18b8333cee6a', '9074a3e0-68a1-4355-9df5-ea6d6b9f032d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:39:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:05 devstack sudo[102921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:39:05 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:05 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.317s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:05 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:39:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Deleted volume successfully.
Sep 29 12:39:05 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f9fdfc87-b856-4eac-9d3a-52de14ed3f90 tempest-VolumeDependencyTests-991151103 None] Lock "cinder-25ee36a8-5073-45f4-bab3-0ea7a37caf70-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (4dd9ad07-85e3-4102-afdf-bfec48ae9f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bb9259-b912-4bb0-b765-6de3c0e20a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bb9259-b912-4bb0-b765-6de3c0e20a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-301459183',display_name='tempest-VolumesGetTest-Volume-260702965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4449a9c-aaa6-45b4-8d4b-584a675f027c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:06Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20df127d-5bf1-4d9f-9928-37814edd4ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20df127d-5bf1-4d9f-9928-37814edd4ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98c1e79-00b5-462f-bae8-8fb518c5f137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98c1e79-00b5-462f-bae8-8fb518c5f137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4449a9c-aaa6-45b4-8d4b-584a675f027c', 'volume_name': 'volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b11de6b-9ff5-4b56-8d82-56402a73beb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b11de6b-9ff5-4b56-8d82-56402a73beb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96facc0-9fab-445d-9925-b43d8900979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Volume b4449a9c-aaa6-45b4-8d4b-584a675f027c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c', 'volume_size': 1}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-301459183',display_name='tempest-VolumesGetTest-Volume-260702965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4449a9c-aaa6-45b4-8d4b-584a675f027c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace716847f09432e94d2c6aaca7a8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:06Z,use_quota=True,user_id='4bdbc2a7e01143bc82a0e38baedbc225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Creating volume b4449a9c-aaa6-45b4-8d4b-584a675f027c {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:39:06 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Acquiring lock "cinder-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:06 devstack sudo[102924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c 1073741824
Sep 29 12:39:06 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Lock "cinder-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Acquiring lock "cinder-quobyte-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Lock "cinder-quobyte-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fcb416-9e64-4fa3-b89a-4f55f99a3561]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:06 devstack sudo[102926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca
Sep 29 12:39:06 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:06 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c 1073741824" returned: 0 in 0.577s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:06 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" returned: 0 in 0.458s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:06 devstack sudo[102935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca
Sep 29 12:39:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:06 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:06 devstack sudo[102937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c
Sep 29 12:39:06 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:07 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Lock "cinder-quobyte-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca" released by "delete_volume" :: held 0.826s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:07 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96facc0-9fab-445d-9925-b43d8900979e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e40ef22-a57a-4c8d-a502-d3468fbb81db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:07 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Volume volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c (b4449a9c-aaa6-45b4-8d4b-584a675f027c): created successfully
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e40ef22-a57a-4c8d-a502-d3468fbb81db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Flow 'volume_create_manager' (4dd9ad07-85e3-4102-afdf-bfec48ae9f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-378ddaea-3604-48c5-aa10-ec47159cdd18 tempest-VolumesGetTest-629353174 None] Created volume successfully.
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Created reservations ['4bffbf71-66ed-463d-9615-4ef58cb7f78d', 'e709eb00-4357-4ba4-93aa-41dbd8de4e30', '3029eb81-da62-462f-9781-b41d7b6b95d6', 'cf282e90-c0b8-47e9-9e14-aa53d561dc20'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:07 devstack sudo[102941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:39:07 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:07 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.293s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:39:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Deleted volume successfully.
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-1abb8527-8aa6-4ca6-a47e-dc809c29ecdb tempest-VolumeDependencyTests-991151103 None] Lock "cinder-49e9dd6b-74b0-4782-a54e-3fcd7dc8d9ca-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:07 devstack sudo[102946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:39:07 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:08 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:39:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:39:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:39:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:39:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-b4449a9c-aaa6-45b4-8d4b-584a675f027c-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Lock "cinder-b4449a9c-aaa6-45b4-8d4b-584a675f027c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-quobyte-b4449a9c-aaa6-45b4-8d4b-584a675f027c" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-b4449a9c-aaa6-45b4-8d4b-584a675f027c" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[627bdd49-2036-4ce8-bb9f-ed15598da8e3]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:08 devstack sudo[102949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c
Sep 29 12:39:08 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:09 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c" returned: 0 in 0.448s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:09 devstack sudo[102955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c
Sep 29 12:39:09 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:09 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b4449a9c-aaa6-45b4-8d4b-584a675f027c" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-b4449a9c-aaa6-45b4-8d4b-584a675f027c" released by "delete_volume" :: held 0.828s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Created reservations ['385d19b3-3ad8-4280-be29-21841694c773', '65e650f0-1468-487d-9666-f8c78a514ce2', 'f8e46940-2a28-4d81-961b-466167a2a6dd', 'dbcdb99a-e883-42cd-a7d9-d2d6b0d9199e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:09 devstack sudo[102958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:39:09 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-0b0abe8d-d869-438b-9032-f19366e3eb95-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Lock "cinder-0b0abe8d-d869-438b-9032-f19366e3eb95-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:09 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.393s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Acquiring lock "cinder-quobyte-0b0abe8d-d869-438b-9032-f19366e3eb95" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Deleted volume successfully.
Sep 29 12:39:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-0b0abe8d-d869-438b-9032-f19366e3eb95" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b03064d1-ed97-4263-98ab-d628de83e69c tempest-VolumesGetTest-629353174 None] Lock "cinder-b4449a9c-aaa6-45b4-8d4b-584a675f027c-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eafddf2-bf21-47c0-bb38-3817a216089a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:10 devstack sudo[102964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95
Sep 29 12:39:10 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:10 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95" returned: 0 in 0.418s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:10 devstack sudo[102970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95
Sep 29 12:39:10 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:10 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0b0abe8d-d869-438b-9032-f19366e3eb95" returned: 0 in 0.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Lock "cinder-quobyte-0b0abe8d-d869-438b-9032-f19366e3eb95" released by "delete_volume" :: held 0.780s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Created reservations ['299647bb-a545-41e0-8d22-f53360452262', '60640a74-5d50-4b08-9b50-ed7481c436b8', '2d1c5fe9-9022-4bb5-b402-df81a8be2a28', 'fe368ea1-f1b0-477c-b3be-5749c26301df'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:10 devstack sudo[102973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:39:10 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:11 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.333s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:39:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Deleted volume successfully.
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5bea389e-c582-4a1a-93c8-405692f21214 tempest-VolumesGetTest-629353174 None] Lock "cinder-0b0abe8d-d869-438b-9032-f19366e3eb95-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Flow 'volume_create_manager' (bc21ecc9-3fc5-462f-b1c9-d6c802ee5780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b708b212-3b46-40f3-959d-b361e076bc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b708b212-3b46-40f3-959d-b361e076bc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf867d4-5d98-4273-9d08-6e0fdb9c495d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f1c8fa83fa454eb08789a47b44ae34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:12Z,use_quota=True,user_id='2bdb2f5840104faebf8f8ae44827a5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cd504c-ad14-40c3-b560-a56e1e82cd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cd504c-ad14-40c3-b560-a56e1e82cd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58ea393-6b15-4388-9c93-fb929edb8d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58ea393-6b15-4388-9c93-fb929edb8d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf867d4-5d98-4273-9d08-6e0fdb9c495d', 'volume_name': 'volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c48d6d-e156-4ab2-968e-b053619e700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c48d6d-e156-4ab2-968e-b053619e700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e1b35b-131e-4553-b686-543cf6eb955e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:11 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Volume ccf867d4-5d98-4273-9d08-6e0fdb9c495d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d', 'volume_size': 1}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf867d4-5d98-4273-9d08-6e0fdb9c495d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f1c8fa83fa454eb08789a47b44ae34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:12Z,use_quota=True,user_id='2bdb2f5840104faebf8f8ae44827a5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Creating volume ccf867d4-5d98-4273-9d08-6e0fdb9c495d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:39:11 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:39:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:11 devstack sudo[102976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d 1073741824
Sep 29 12:39:11 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:12 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d 1073741824" returned: 0 in 0.652s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:12 devstack sudo[102992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d
Sep 29 12:39:12 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:12 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:39:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e1b35b-131e-4553-b686-543cf6eb955e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0a5115-a2b3-4b22-aa5c-9ca76f1a044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Volume volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d (ccf867d4-5d98-4273-9d08-6e0fdb9c495d): created successfully
Sep 29 12:39:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0a5115-a2b3-4b22-aa5c-9ca76f1a044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Flow 'volume_create_manager' (bc21ecc9-3fc5-462f-b1c9-d6c802ee5780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-631a086e-c8ab-4d5c-add8-4ca81d8130f3 tempest-CinderUnicodeTest-502299417 None] Created volume successfully.
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Flow 'volume_create_manager' (fbd3038b-2f1c-42a0-ab85-e76cdf7ba761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38d86d9-e7f2-499e-8342-ba26af061fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38d86d9-e7f2-499e-8342-ba26af061fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2045264684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff989f5-658a-4de8-a6d1-548878299c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f1c8fa83fa454eb08789a47b44ae34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:14Z,use_quota=True,user_id='2bdb2f5840104faebf8f8ae44827a5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97ab76c-55df-46b4-8a2b-f58598a31449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97ab76c-55df-46b4-8a2b-f58598a31449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae83308-086d-4ff4-a607-b75781ff46f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae83308-086d-4ff4-a607-b75781ff46f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff989f5-658a-4de8-a6d1-548878299c2a', 'volume_name': 'volume-3ff989f5-658a-4de8-a6d1-548878299c2a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f987f7-cf69-4237-bbf8-394c3c00b8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f987f7-cf69-4237-bbf8-394c3c00b8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49dcfcc-6022-4337-a8e8-2deb9929ce3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Volume 3ff989f5-658a-4de8-a6d1-548878299c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff989f5-658a-4de8-a6d1-548878299c2a', 'volume_size': 1}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2045264684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff989f5-658a-4de8-a6d1-548878299c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f1c8fa83fa454eb08789a47b44ae34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:14Z,use_quota=True,user_id='2bdb2f5840104faebf8f8ae44827a5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Creating volume 3ff989f5-658a-4de8-a6d1-548878299c2a {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:39:14 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:39:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:14 devstack sudo[103002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a 1073741824
Sep 29 12:39:14 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:15 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a 1073741824" returned: 0 in 0.675s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:15 devstack sudo[103008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a
Sep 29 12:39:15 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:15 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a" returned: 0 in 0.564s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:39:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49dcfcc-6022-4337-a8e8-2deb9929ce3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff989f5-658a-4de8-a6d1-548878299c2a', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3862ca7-e64c-4605-a119-23f7be7e0ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:15 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Volume volume-3ff989f5-658a-4de8-a6d1-548878299c2a (3ff989f5-658a-4de8-a6d1-548878299c2a): created successfully
Sep 29 12:39:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3862ca7-e64c-4605-a119-23f7be7e0ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Flow 'volume_create_manager' (fbd3038b-2f1c-42a0-ab85-e76cdf7ba761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-acf4c32a-32aa-44ca-a863-5cb3eb5d8120 tempest-CinderUnicodeTest-502299417 None] Created volume successfully.
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Flow 'volume_create_manager' (392a722c-99b4-4346-a377-b34f1c6cedef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803b747f-b1a1-47a2-a0d7-d187192ce6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] Creating offline snapshot 92c6e12b-fdf1-40fb-a2c4-980108b426eb of volume 3ff989f5-658a-4de8-a6d1-548878299c2a {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803b747f-b1a1-47a2-a0d7-d187192ce6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-545849901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a7aaaf-e16a-4747-96a9-d6eccfc4f887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2282d235aa64483fb8875881fed26251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:17Z,use_quota=True,user_id='10d12a6af17749ec9ca4396d531a6322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f967d12d-ecf9-4634-b69b-964510d278ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f967d12d-ecf9-4634-b69b-964510d278ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c61121-b42f-4764-a994-8d6d2cbf56ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c61121-b42f-4764-a994-8d6d2cbf56ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a7aaaf-e16a-4747-96a9-d6eccfc4f887', 'volume_name': 'volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887', 'volume_size': 2}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493e5238-c1f4-41a7-a7e6-257b1ef09c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493e5238-c1f4-41a7-a7e6-257b1ef09c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e057cb0a-d515-4b18-8603-4dd09a116aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Volume a9a7aaaf-e16a-4747-96a9-d6eccfc4f887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887', 'volume_size': 2}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3965cd4c-0e1c-4f6e-8227-feea17a76246]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:17 devstack sudo[103094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a
Sep 29 12:39:17 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:17 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a" returned: 0 in 0.386s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:17 devstack sudo[103099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb 1G
Sep 29 12:39:17 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:18 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb 1G" returned: 0 in 0.619s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff989f5-658a-4de8-a6d1-548878299c2a -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:18 devstack sudo[103107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff989f5-658a-4de8-a6d1-548878299c2a -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb
Sep 29 12:39:18 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:18 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff989f5-658a-4de8-a6d1-548878299c2a -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:18 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb is being set with open permissions: ugo+rw
Sep 29 12:39:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:18 devstack sudo[103113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb
Sep 29 12:39:18 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:19 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb" returned: 0 in 0.281s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:19 devstack sudo[103116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.info
Sep 29 12:39:19 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:19 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.info" returned: 0 in 0.329s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:19 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.info is being set with open permissions: ugo+rw
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:19 devstack sudo[103120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.info
Sep 29 12:39:19 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:19 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.info" returned: 0 in 0.346s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.451s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-545849901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a7aaaf-e16a-4747-96a9-d6eccfc4f887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2282d235aa64483fb8875881fed26251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:17Z,use_quota=True,user_id='10d12a6af17749ec9ca4396d531a6322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Creating volume a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:39:19 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:39:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 2147483648 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:19 devstack sudo[103131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 2147483648
Sep 29 12:39:19 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-06bea6d5-440b-436f-9e4d-079bff7f3602 tempest-CinderUnicodeTest-502299417 None] Create snapshot completed successfully
Sep 29 12:39:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Acquiring lock "cinder-92c6e12b-fdf1-40fb-a2c4-980108b426eb-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Lock "cinder-92c6e12b-fdf1-40fb-a2c4-980108b426eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Acquiring lock "cinder-quobyte-3ff989f5-658a-4de8-a6d1-548878299c2a" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Lock "cinder-quobyte-3ff989f5-658a-4de8-a6d1-548878299c2a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Acquiring lock "cinder-quobyte-92c6e12b-fdf1-40fb-a2c4-980108b426eb" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Lock "cinder-quobyte-92c6e12b-fdf1-40fb-a2c4-980108b426eb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Deleting offline snapshot 92c6e12b-fdf1-40fb-a2c4-980108b426eb of volume 3ff989f5-658a-4de8-a6d1-548878299c2a {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:39:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] snapshot_file for this snap is: volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:39:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f535bd-fd24-4fd6-ac8f-8f7baf81517b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:20 devstack sudo[103139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb
Sep 29 12:39:20 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:20 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 2147483648" returned: 0 in 1.042s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:21 devstack sudo[103141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887
Sep 29 12:39:21 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:21 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb" returned: 0 in 0.602s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ff989f5-658a-4de8-a6d1-548878299c2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[009940e6-2a4a-46dd-b121-f3e78310c516]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:21 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e057cb0a-d515-4b18-8603-4dd09a116aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887', 'volume_size': 2}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79500802-408d-446d-9aa6-93de4ada69cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Volume volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 (a9a7aaaf-e16a-4747-96a9-d6eccfc4f887): created successfully
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79500802-408d-446d-9aa6-93de4ada69cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Flow 'volume_create_manager' (392a722c-99b4-4346-a377-b34f1c6cedef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ed44a9fc-d66f-4bd0-91c7-70d492739f27 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Created volume successfully.
Sep 29 12:39:21 devstack sudo[103149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a
Sep 29 12:39:21 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:21 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a" returned: 0 in 0.532s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:21 devstack sudo[103156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb
Sep 29 12:39:21 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Creating offline snapshot 7ca91c39-a02d-4ea3-a760-66e8a836c092 of volume a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad37688c-e182-4563-92ac-9b9791f392ce]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:22 devstack sudo[103158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887
Sep 29 12:39:22 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:22 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb" returned: 0 in 0.421s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:22 devstack sudo[103165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb
Sep 29 12:39:22 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:22 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887" returned: 0 in 0.472s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092 2G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:22 devstack sudo[103172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092 2G
Sep 29 12:39:22 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:22 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a.92c6e12b-fdf1-40fb-a2c4-980108b426eb" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Lock "cinder-quobyte-92c6e12b-fdf1-40fb-a2c4-980108b426eb" released by "_delete_snapshot" :: held 2.048s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Lock "cinder-quobyte-3ff989f5-658a-4de8-a6d1-548878299c2a" released by "delete_snapshot" :: held 2.083s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Created reservations ['f41f34da-9f3a-47c0-9eb6-3ea7a7771474', '11c988ab-3ee0-4b43-8a30-eb01e919f660', '8965846a-9353-46fe-8466-9de2567dd876', 'de9748be-78a6-42fb-b372-c9403cd6e341'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:39:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Delete snapshot completed successfully.
Sep 29 12:39:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5b3092f7-0825-42a5-aa28-bf852a7b2623 tempest-CinderUnicodeTest-502299417 None] Lock "cinder-92c6e12b-fdf1-40fb-a2c4-980108b426eb-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:23 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092 2G" returned: 0 in 0.495s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:23 devstack sudo[103178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092
Sep 29 12:39:23 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:23 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:23 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092 is being set with open permissions: ugo+rw
Sep 29 12:39:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:23 devstack sudo[103183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092
Sep 29 12:39:23 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:23 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:23 devstack sudo[103186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.info
Sep 29 12:39:23 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Acquiring lock "cinder-3ff989f5-658a-4de8-a6d1-548878299c2a-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Lock "cinder-3ff989f5-658a-4de8-a6d1-548878299c2a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Acquiring lock "cinder-quobyte-3ff989f5-658a-4de8-a6d1-548878299c2a" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Lock "cinder-quobyte-3ff989f5-658a-4de8-a6d1-548878299c2a" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:24 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.info" returned: 0 in 0.356s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:24 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.info is being set with open permissions: ugo+rw
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[da442b4e-39ad-41d1-8491-2cb997f80086]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:24 devstack sudo[103189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.info
Sep 29 12:39:24 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:24 devstack sudo[103190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a
Sep 29 12:39:24 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:24 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.info" returned: 0 in 0.266s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-03884662-8315-4d98-9bfc-844eb18a4726 tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Create snapshot completed successfully
Sep 29 12:39:24 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a" returned: 0 in 0.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:24 devstack sudo[103197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a
Sep 29 12:39:24 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:24 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3ff989f5-658a-4de8-a6d1-548878299c2a" returned: 0 in 0.287s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Lock "cinder-quobyte-3ff989f5-658a-4de8-a6d1-548878299c2a" released by "delete_volume" :: held 0.771s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Created reservations ['6cdcf2bd-35d9-40c9-8d8d-41777ae49b91', '52cc9188-4650-4932-8428-ed86d6c40c2e', '896b1ff8-d904-4ec8-a23e-4d0f7d52ac80', 'a9faba85-5834-4106-8f33-dfd82adb17b7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:24 devstack sudo[103201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:39:24 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Acquiring lock "cinder-ccf867d4-5d98-4273-9d08-6e0fdb9c495d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Lock "cinder-ccf867d4-5d98-4273-9d08-6e0fdb9c495d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:25 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Acquiring lock "cinder-quobyte-ccf867d4-5d98-4273-9d08-6e0fdb9c495d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Deleted volume successfully.
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Lock "cinder-quobyte-ccf867d4-5d98-4273-9d08-6e0fdb9c495d" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-d4f632e5-f429-4ef2-a61e-1f274c911baf tempest-CinderUnicodeTest-502299417 None] Lock "cinder-3ff989f5-658a-4de8-a6d1-548878299c2a-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed2be69-a942-4e71-bca9-90b1e78d4f0d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Acquiring lock "cinder-7ca91c39-a02d-4ea3-a760-66e8a836c092-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "cinder-7ca91c39-a02d-4ea3-a760-66e8a836c092-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Acquiring lock "cinder-quobyte-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "cinder-quobyte-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Acquiring lock "cinder-quobyte-7ca91c39-a02d-4ea3-a760-66e8a836c092" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "cinder-quobyte-7ca91c39-a02d-4ea3-a760-66e8a836c092" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Deleting offline snapshot 7ca91c39-a02d-4ea3-a760-66e8a836c092 of volume a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] snapshot_file for this snap is: volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3008d10-3212-448f-96b2-308b1dca8dba]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:25 devstack sudo[103204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d
Sep 29 12:39:25 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:25 devstack sudo[103206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092
Sep 29 12:39:25 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:25 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d" returned: 0 in 0.467s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:25 devstack sudo[103212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d
Sep 29 12:39:25 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:25 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092" returned: 0 in 0.476s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[390bee1a-b2bf-4443-8660-0e0016cd37a3]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:26 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ccf867d4-5d98-4273-9d08-6e0fdb9c495d" returned: 0 in 0.292s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Lock "cinder-quobyte-ccf867d4-5d98-4273-9d08-6e0fdb9c495d" released by "delete_volume" :: held 0.822s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:26 devstack sudo[103217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887
Sep 29 12:39:26 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Created reservations ['79c2ccf1-75a0-4bea-8c29-22c21128706f', 'd2923270-ff7f-4805-8139-b217445086a9', 'c6eeeeff-cc4b-49bc-b05c-24852b31682a', '42e89344-c466-4209-8f39-6a322f5ec46e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:26 devstack sudo[103220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:39:26 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:26 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887" returned: 0 in 0.482s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:26 devstack sudo[103225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092
Sep 29 12:39:26 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:26 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.360s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:39:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Deleted volume successfully.
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2d11aa86-c5eb-4219-889c-6f2bf52c800e tempest-CinderUnicodeTest-502299417 None] Lock "cinder-ccf867d4-5d98-4273-9d08-6e0fdb9c495d-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:26 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092" returned: 0 in 0.472s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:27 devstack sudo[103231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092
Sep 29 12:39:27 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:27 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887.7ca91c39-a02d-4ea3-a760-66e8a836c092" returned: 0 in 0.301s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "cinder-quobyte-7ca91c39-a02d-4ea3-a760-66e8a836c092" released by "_delete_snapshot" :: held 1.855s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "cinder-quobyte-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887" released by "delete_snapshot" :: held 1.889s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:27 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Created reservations ['b7408910-de6b-454f-b9f4-9270cd78ac7f', '1201ac11-cc1d-46ab-a47c-002c889c500b', 'd982d61c-2de2-44ab-a9ae-73b5e60b2ad4', '0e2ae118-5e31-41a7-822e-44f0c4d76af1'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:39:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Delete snapshot completed successfully.
Sep 29 12:39:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93846b90-0365-48b7-b0a4-5db97526039d tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "cinder-7ca91c39-a02d-4ea3-a760-66e8a836c092-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Acquiring lock "cinder-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "cinder-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Acquiring lock "cinder-quobyte-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "cinder-quobyte-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[615babf6-fe63-4651-91b9-1427b25b546b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:27 devstack sudo[103234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887
Sep 29 12:39:27 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:28 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887" returned: 0 in 0.434s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:28 devstack sudo[103239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887
Sep 29 12:39:28 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:28 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887" returned: 0 in 0.281s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "cinder-quobyte-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887" released by "delete_volume" :: held 0.799s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:28 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Created reservations ['444c011d-fb8e-44fe-a98b-c48bef6e0ce8', 'cac6f390-4bcb-401e-b5fe-9b6aa5cef915', '5b598671-e525-4cde-9aa4-225dd2d32755', 'f608db37-8bb3-491a-b5cb-657682dd413c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:39:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:28 devstack sudo[103242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:39:28 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:29 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.304s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:29 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:39:29 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Deleted volume successfully.
Sep 29 12:39:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3ef5dd50-2b84-4b0b-be7f-8f2f31f4aa2a tempest-VolumesSnapshotNegativeTestJSON-61458739 None] Lock "cinder-a9a7aaaf-e16a-4747-96a9-d6eccfc4f887-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:INSERT=39,cinder:UPDATE=156,cinder:SELECT=118,cinder:DELETE=12 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=115,cinder:INSERT=50,cinder:UPDATE=152,cinder:DELETE=13 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Flow 'volume_create_manager' (9fbb84dd-c3be-42fe-8301-3fb303c0a8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc49308-368f-4dd6-9a2d-1af8ddb13223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc49308-368f-4dd6-9a2d-1af8ddb13223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a889d84-41ec-40a7-a040-5650d4d42e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbd7fa3a8d84818a4c7c1c06f220dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:35Z,use_quota=True,user_id='778b5bc7a55e4a5aa24880f1ecca908c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7215ff57-311b-47b5-b6c4-acd479b315d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7215ff57-311b-47b5-b6c4-acd479b315d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cf58ec-ec4f-4e5a-bf00-7c1795bf8d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4cf58ec-ec4f-4e5a-bf00-7c1795bf8d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a889d84-41ec-40a7-a040-5650d4d42e65', 'volume_name': 'volume-5a889d84-41ec-40a7-a040-5650d4d42e65', 'volume_size': 1, 'image_id': '5d1b2e5f-869d-446b-a8d0-151101b41871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d1b2e5f-869d-446b-a8d0-151101b41871', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f459d686ab0e078695148094c23b32d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8dbd7fa3a8d84818a4c7c1c06f220dae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf5e590bea84cd498d2bf4cdf94b1419fc99619ee38028b99e7a76a84d8f7c500798926efe8a5f1085413125f29158ff6282976f30599f084381ea5d65c5f269', 'id': '5d1b2e5f-869d-446b-a8d0-151101b41871', 'created_at': datetime.datetime(2026, 9, 29, 10, 39, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d1b2e5f-869d-446b-a8d0-151101b41871/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b7025b85310>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba0ebb8-a237-42a8-a8b6-6a41278178f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba0ebb8-a237-42a8-a8b6-6a41278178f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fe46e8-ffb5-4a3a-9aec-3f93f91b91da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:35 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Volume 5a889d84-41ec-40a7-a040-5650d4d42e65: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a889d84-41ec-40a7-a040-5650d4d42e65', 'volume_size': 1, 'image_id': '5d1b2e5f-869d-446b-a8d0-151101b41871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d1b2e5f-869d-446b-a8d0-151101b41871', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f459d686ab0e078695148094c23b32d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8dbd7fa3a8d84818a4c7c1c06f220dae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf5e590bea84cd498d2bf4cdf94b1419fc99619ee38028b99e7a76a84d8f7c500798926efe8a5f1085413125f29158ff6282976f30599f084381ea5d65c5f269', 'id': '5d1b2e5f-869d-446b-a8d0-151101b41871', 'created_at': datetime.datetime(2026, 9, 29, 10, 39, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d1b2e5f-869d-446b-a8d0-151101b41871/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b7025b85310>}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Trying to clone 5a889d84-41ec-40a7-a040-5650d4d42e65 from image 5d1b2e5f-869d-446b-a8d0-151101b41871 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d1b2e5f-869d-446b-a8d0-151101b41871', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 12:39:35 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Image download 0.00 MB at 0.00 MB/s
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aceba64-c429-435d-9f2c-2538a25d406b]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:35 devstack sudo[103265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD
Sep 29 12:39:35 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:35 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:36 devstack sudo[103269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD
Sep 29 12:39:36 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:36 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:39:36 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Temporary image 5d1b2e5f-869d-446b-a8d0-151101b41871 is fetched for user 778b5bc7a55e4a5aa24880f1ecca908c. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 12:39:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1babed4e-8a43-442b-821a-41658f39c0ce]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:36 devstack sudo[103274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD
Sep 29 12:39:36 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:36 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:36 devstack sudo[103278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD
Sep 29 12:39:36 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:37 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD" returned: 1 in 0.405s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a889d84-41ec-40a7-a040-5650d4d42e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbd7fa3a8d84818a4c7c1c06f220dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:35Z,use_quota=True,user_id='778b5bc7a55e4a5aa24880f1ecca908c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Creating volume 5a889d84-41ec-40a7-a040-5650d4d42e65 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:39:37 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:37 devstack sudo[103283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65 1073741824
Sep 29 12:39:37 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:37 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65 1073741824" returned: 0 in 0.617s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:37 devstack sudo[103289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65
Sep 29 12:39:37 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:38 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:39:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:38 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Attempting download of 5d1b2e5f-869d-446b-a8d0-151101b41871 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d1b2e5f-869d-446b-a8d0-151101b41871', 'metadata': {}}])) to volume 5a889d84-41ec-40a7-a040-5650d4d42e65. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 12:39:38 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a82692-8bed-48cc-9a1b-1da4de31bc7f]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d1b2e5f-869d-446b-a8d0-151101b41871_tihnzkkv {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:38 devstack sudo[103292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d1b2e5f-869d-446b-a8d0-151101b41871_tihnzkkv
Sep 29 12:39:38 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:38 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d1b2e5f-869d-446b-a8d0-151101b41871_tihnzkkv" returned: 0 in 0.389s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d1b2e5f-869d-446b-a8d0-151101b41871_tihnzkkv {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:38 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d1b2e5f-869d-446b-a8d0-151101b41871_tihnzkkv
Sep 29 12:39:38 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:39 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d1b2e5f-869d-446b-a8d0-151101b41871_tihnzkkv" returned: 1 in 0.425s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d1b2e5f-869d-446b-a8d0-151101b41871_tihnzkkv' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:39:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[163e0865-7db5-481a-ad46-b30266e3034e]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:39 devstack sudo[103301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD
Sep 29 12:39:39 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:39 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:39 devstack sudo[103305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD
Sep 29 12:39:39 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:39 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:39:39 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] 5d1b2e5f-869d-446b-a8d0-151101b41871 was raw, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 12:39:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:39 devstack sudo[103310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65
Sep 29 12:39:39 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:40 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65" returned: 0 in 0.524s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d1b2e5f-869d-446b-a8d0-151101b41871_9iro83xsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:39:40 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Converted 0.00 MB image at 0.00 MB/s
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:40 devstack sudo[103317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65 1G
Sep 29 12:39:40 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:40 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65 1G" returned: 0 in 0.343s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Downloaded image 5d1b2e5f-869d-446b-a8d0-151101b41871 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d1b2e5f-869d-446b-a8d0-151101b41871', 'metadata': {}}])) to volume 5a889d84-41ec-40a7-a040-5650d4d42e65 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Temporary image 5d1b2e5f-869d-446b-a8d0-151101b41871 for user 778b5bc7a55e4a5aa24880f1ecca908c is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Marking volume 5a889d84-41ec-40a7-a040-5650d4d42e65 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Copying metadata from image 5d1b2e5f-869d-446b-a8d0-151101b41871 to 5a889d84-41ec-40a7-a040-5650d4d42e65. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Creating volume glance metadata for volume 5a889d84-41ec-40a7-a040-5650d4d42e65 backed by image 5d1b2e5f-869d-446b-a8d0-151101b41871 with: {'image_id': '5d1b2e5f-869d-446b-a8d0-151101b41871', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f459d686ab0e078695148094c23b32d6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fe46e8-ffb5-4a3a-9aec-3f93f91b91da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a889d84-41ec-40a7-a040-5650d4d42e65', 'volume_size': 1, 'image_id': '5d1b2e5f-869d-446b-a8d0-151101b41871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d1b2e5f-869d-446b-a8d0-151101b41871', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f459d686ab0e078695148094c23b32d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8dbd7fa3a8d84818a4c7c1c06f220dae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf5e590bea84cd498d2bf4cdf94b1419fc99619ee38028b99e7a76a84d8f7c500798926efe8a5f1085413125f29158ff6282976f30599f084381ea5d65c5f269', 'id': '5d1b2e5f-869d-446b-a8d0-151101b41871', 'created_at': datetime.datetime(2026, 9, 29, 10, 39, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 39, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d1b2e5f-869d-446b-a8d0-151101b41871/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b7025b85310>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e981353-0cf2-44f6-bf83-5fce992ad476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:40 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Volume volume-5a889d84-41ec-40a7-a040-5650d4d42e65 (5a889d84-41ec-40a7-a040-5650d4d42e65): created successfully
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e981353-0cf2-44f6-bf83-5fce992ad476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:40 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Flow 'volume_create_manager' (9fbb84dd-c3be-42fe-8301-3fb303c0a8c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7a06875a-7c7a-409e-baa0-8b2e40b1181f tempest-VolumeImageDependencyTests-1107176322 None] Created volume successfully.
Sep 29 12:39:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Acquiring lock "cinder-5a889d84-41ec-40a7-a040-5650d4d42e65-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Lock "cinder-5a889d84-41ec-40a7-a040-5650d4d42e65-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Acquiring lock "cinder-quobyte-5a889d84-41ec-40a7-a040-5650d4d42e65" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Lock "cinder-quobyte-5a889d84-41ec-40a7-a040-5650d4d42e65" acquired by "delete_volume" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[de727ed3-933f-49e0-b575-2bbb35bf567b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:41 devstack sudo[103324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65
Sep 29 12:39:41 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:42 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65" returned: 0 in 0.425s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:42 devstack sudo[103329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65
Sep 29 12:39:42 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:42 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-5a889d84-41ec-40a7-a040-5650d4d42e65" returned: 0 in 0.313s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Lock "cinder-quobyte-5a889d84-41ec-40a7-a040-5650d4d42e65" released by "delete_volume" :: held 0.815s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:42 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Created reservations ['0afb2bee-9e22-4d87-8763-d6db6c38df1d', 'ea116da2-fb46-493d-b8b3-fbd8a3643bfd', '66e8f6e2-5b5c-4c1a-8aac-75de37debbe3', 'a9935b51-a183-4982-a554-e1ece350fbb5'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:39:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:42 devstack sudo[103332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:39:42 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:42 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:39:43 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Flow 'volume_create_manager' (d427e1e3-0ce5-4e2f-8ca7-dd51fc8988fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61260c69-4f08-489e-9d0f-d0b24dd365ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.351s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:39:43 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Deleted volume successfully.
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61260c69-4f08-489e-9d0f-d0b24dd365ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2072875440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12dd35b-cb58-4462-a507-125d8e8d354f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732ff967a7fe4d758fece7639ab1c2b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:43Z,use_quota=True,user_id='5c14a66a96a742d6801c9e9cca72341e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b863a5-cb9e-4224-b706-36850962dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b863a5-cb9e-4224-b706-36850962dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bb65ea-8a09-4be9-a160-faeee5056d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bb65ea-8a09-4be9-a160-faeee5056d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c12dd35b-cb58-4462-a507-125d8e8d354f', 'volume_name': 'volume-c12dd35b-cb58-4462-a507-125d8e8d354f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39981e51-937b-4857-ae0f-e327621c07a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39981e51-937b-4857-ae0f-e327621c07a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1441b052-a778-467e-a986-6800e3b8711e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:43 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Volume c12dd35b-cb58-4462-a507-125d8e8d354f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c12dd35b-cb58-4462-a507-125d8e8d354f', 'volume_size': 1}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2072875440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12dd35b-cb58-4462-a507-125d8e8d354f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732ff967a7fe4d758fece7639ab1c2b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:43Z,use_quota=True,user_id='5c14a66a96a742d6801c9e9cca72341e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Creating volume c12dd35b-cb58-4462-a507-125d8e8d354f {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:39:43 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c12dd35b-cb58-4462-a507-125d8e8d354f 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b84ad736-c6b3-4271-b1f6-ee9f587f964d tempest-VolumeImageDependencyTests-1107176322 None] Lock "cinder-5a889d84-41ec-40a7-a040-5650d4d42e65-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:43 devstack sudo[103335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c12dd35b-cb58-4462-a507-125d8e8d354f 1073741824
Sep 29 12:39:43 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:43 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c12dd35b-cb58-4462-a507-125d8e8d354f 1073741824" returned: 0 in 0.561s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c12dd35b-cb58-4462-a507-125d8e8d354f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:43 devstack sudo[103341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c12dd35b-cb58-4462-a507-125d8e8d354f
Sep 29 12:39:43 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:44 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c12dd35b-cb58-4462-a507-125d8e8d354f" returned: 0 in 0.328s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:39:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1441b052-a778-467e-a986-6800e3b8711e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12dd35b-cb58-4462-a507-125d8e8d354f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bdb073-636b-4b46-a3a4-32f2c9263110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:44 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Volume volume-c12dd35b-cb58-4462-a507-125d8e8d354f (c12dd35b-cb58-4462-a507-125d8e8d354f): created successfully
Sep 29 12:39:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bdb073-636b-4b46-a3a4-32f2c9263110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Flow 'volume_create_manager' (d427e1e3-0ce5-4e2f-8ca7-dd51fc8988fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-26039141-3655-4642-8e59-e78438b0c02b tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Created volume successfully.
Sep 29 12:39:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c9a2af4c-03da-445d-82e7-c3f1b366394f req-5acf246e-5f49-44dc-8d02-28ffdce8b035 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c9a2af4c-03da-445d-82e7-c3f1b366394f req-5acf246e-5f49-44dc-8d02-28ffdce8b035 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-c9a2af4c-03da-445d-82e7-c3f1b366394f req-5acf246e-5f49-44dc-8d02-28ffdce8b035 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-c9a2af4c-03da-445d-82e7-c3f1b366394f req-5acf246e-5f49-44dc-8d02-28ffdce8b035 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-c12dd35b-cb58-4462-a507-125d8e8d354f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71f12bc4-2c36-49f0-a77b-a4e20823d0e4', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:39:46 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-c9a2af4c-03da-445d-82e7-c3f1b366394f req-5acf246e-5f49-44dc-8d02-28ffdce8b035 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] attachment_update completed successfully.
Sep 29 12:39:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-00107984-41cd-4d0e-92ca-da8729f17f10 req-fcf8df90-7664-4385-904e-3730ff6def1d tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Terminate volume connection completed successfully.
Sep 29 12:39:50 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-00107984-41cd-4d0e-92ca-da8729f17f10 req-fcf8df90-7664-4385-904e-3730ff6def1d tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Deleting attachment 71f12bc4-2c36-49f0-a77b-a4e20823d0e4. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:39:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Acquiring lock "cinder-c12dd35b-cb58-4462-a507-125d8e8d354f-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Lock "cinder-c12dd35b-cb58-4462-a507-125d8e8d354f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Acquiring lock "cinder-quobyte-c12dd35b-cb58-4462-a507-125d8e8d354f" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Lock "cinder-quobyte-c12dd35b-cb58-4462-a507-125d8e8d354f" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:51 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5652d9e-9b54-42b0-bc70-6f12f34c1fdc]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c12dd35b-cb58-4462-a507-125d8e8d354f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:51 devstack sudo[103806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c12dd35b-cb58-4462-a507-125d8e8d354f
Sep 29 12:39:51 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:51 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c12dd35b-cb58-4462-a507-125d8e8d354f" returned: 0 in 0.525s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c12dd35b-cb58-4462-a507-125d8e8d354f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:51 devstack sudo[103811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c12dd35b-cb58-4462-a507-125d8e8d354f
Sep 29 12:39:51 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:52 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-c12dd35b-cb58-4462-a507-125d8e8d354f" returned: 0 in 0.311s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Lock "cinder-quobyte-c12dd35b-cb58-4462-a507-125d8e8d354f" released by "delete_volume" :: held 0.961s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Created reservations ['cdf6667a-67f4-4d69-861c-4d19ad6670c6', 'ace2b8ad-12c6-4f99-be22-fed373cd10e8', '155ce959-84e8-45d7-987f-282a441a3b93', '81636135-56a4-4609-8520-3c7e05f2db24'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:52 devstack sudo[103814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:39:52 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:52 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:39:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Deleted volume successfully.
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3418b841-44df-48db-82c9-dd37b9d44683 tempest-TestServerVolumeAttachScenarioOldVersion-1406787666 None] Lock "cinder-c12dd35b-cb58-4462-a507-125d8e8d354f-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Flow 'volume_create_manager' (84d621af-7e44-4865-b96d-5355e1ae5ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327c3d9a-e10a-49bb-983b-7c82f497dfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327c3d9a-e10a-49bb-983b-7c82f497dfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2064829980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b53dda640904e52b2bad70ce8a9ac37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:53Z,use_quota=True,user_id='fdc0aeb29c0a4448b744e2cde0657716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbe172d-0d00-400f-b2f8-cb4c91980345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbe172d-0d00-400f-b2f8-cb4c91980345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0b9fef-adc1-4e5e-8704-3ddbc71f5024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0b9fef-adc1-4e5e-8704-3ddbc71f5024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4', 'volume_name': 'volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c41f52-a60a-478c-ad9d-48c83e300817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c41f52-a60a-478c-ad9d-48c83e300817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfa2610-da7e-4f60-bab4-06296a99a26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Volume a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4', 'volume_size': 1}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2064829980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b53dda640904e52b2bad70ce8a9ac37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:53Z,use_quota=True,user_id='fdc0aeb29c0a4448b744e2cde0657716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Creating volume a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:39:53 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:53 devstack sudo[103817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 1073741824
Sep 29 12:39:53 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:53 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 1073741824" returned: 0 in 0.575s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:53 devstack sudo[103825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4
Sep 29 12:39:53 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:54 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4" returned: 0 in 0.397s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:39:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfa2610-da7e-4f60-bab4-06296a99a26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3d2f5a-e893-424a-b59c-7d72fa08afe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:54 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Volume volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 (a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4): created successfully
Sep 29 12:39:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3d2f5a-e893-424a-b59c-7d72fa08afe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:54 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Flow 'volume_create_manager' (84d621af-7e44-4865-b96d-5355e1ae5ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:54 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3fcd53c7-d80e-4f8f-9212-be5fa1a43f50 tempest-SnapshotDependencyTests-453494143 None] Created volume successfully.
Sep 29 12:39:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] Creating offline snapshot 4dbb49bd-36dd-4176-af50-ed5524aceda3 of volume a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:39:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fda52a-bf71-463a-8061-5ecd060bc3c1]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:55 devstack sudo[103855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4
Sep 29 12:39:55 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:56 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4" returned: 0 in 0.511s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:56 devstack sudo[103861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3 1G
Sep 29 12:39:56 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:56 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3 1G" returned: 0 in 0.610s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:56 devstack sudo[103874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3
Sep 29 12:39:56 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:56 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3" returned: 0 in 0.330s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:56 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3 is being set with open permissions: ugo+rw
Sep 29 12:39:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:56 devstack sudo[103880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3
Sep 29 12:39:56 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:57 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3" returned: 0 in 0.270s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:57 devstack sudo[103917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.info
Sep 29 12:39:57 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:57 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.info" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:57 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.info is being set with open permissions: ugo+rw
Sep 29 12:39:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:57 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.info
Sep 29 12:39:57 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:57 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.info" returned: 0 in 0.273s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-84b9e46a-80c9-42e8-968c-7283d7cc4135 tempest-SnapshotDependencyTests-453494143 None] Create snapshot completed successfully
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Flow 'volume_create_manager' (89e2a8c8-5053-4249-bb11-3d54896358da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb2e1b8-d3a2-4aaf-9397-226076804a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb2e1b8-d3a2-4aaf-9397-226076804a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830eecc7-4c97-4baa-b68f-14e8c09ac9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b53dda640904e52b2bad70ce8a9ac37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4dbb49bd-36dd-4176-af50-ed5524aceda3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:39:59Z,use_quota=True,user_id='fdc0aeb29c0a4448b744e2cde0657716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ae891f-ebe4-4015-b530-e536956171f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ae891f-ebe4-4015-b530-e536956171f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c9a856-f856-4305-8c88-b5d64ced60e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c9a856-f856-4305-8c88-b5d64ced60e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '830eecc7-4c97-4baa-b68f-14e8c09ac9f9', 'volume_name': 'volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9', 'volume_size': 1, 'snapshot_id': '4dbb49bd-36dd-4176-af50-ed5524aceda3'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4caf175-d820-4828-8b37-17b37b5d1aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4caf175-d820-4828-8b37-17b37b5d1aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9bad55f-88fe-4437-b512-c7447145079d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:39:59 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Volume 830eecc7-4c97-4baa-b68f-14e8c09ac9f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9', 'volume_size': 1, 'snapshot_id': '4dbb49bd-36dd-4176-af50-ed5524aceda3'}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "cinder-quobyte-4dbb49bd-36dd-4176-af50-ed5524aceda3-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-quobyte-4dbb49bd-36dd-4176-af50-ed5524aceda3-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Creating volume 830eecc7-4c97-4baa-b68f-14e8c09ac9f9 from snapshot 4dbb49bd-36dd-4176-af50-ed5524aceda3 {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "cinder-quobyte-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-quobyte-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] snapshot: 4dbb49bd-36dd-4176-af50-ed5524aceda3, volume: 830eecc7-4c97-4baa-b68f-14e8c09ac9f9,  {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd31df81-6858-4c32-9a65-03bbfd2a03a9]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:39:59 devstack sudo[103925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3
Sep 29 12:39:59 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:39:59 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3" returned: 0 in 0.399s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d89f64-df15-4eb5-a23e-7b08fd0f703e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:39:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:00 devstack sudo[103930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4
Sep 29 12:40:00 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:00 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4" returned: 0 in 0.394s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 12:40:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 12:40:00 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Path /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9 not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 12:40:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:00 devstack sudo[103936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9
Sep 29 12:40:00 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:07 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" returned: 0 in 7.166s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4, size 1024.00 MB, duration 7.17 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:40:07 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Converted 1024.00 MB image at 142.88 MB/s
Sep 29 12:40:07 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9 is being set with open permissions: ugo+rw
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:07 devstack sudo[103955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9
Sep 29 12:40:07 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:07 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" returned: 0 in 0.258s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-quobyte-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" released by "_copy_volume_from_snapshot" :: held 8.317s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-quobyte-4dbb49bd-36dd-4176-af50-ed5524aceda3-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" released by "_create_volume_from_snapshot" :: held 8.382s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.405s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9bad55f-88fe-4437-b512-c7447145079d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9', 'volume_size': 1, 'snapshot_id': '4dbb49bd-36dd-4176-af50-ed5524aceda3'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446f455e-9988-4a38-a3d5-7baa3e0f5b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:07 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Volume volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9 (830eecc7-4c97-4baa-b68f-14e8c09ac9f9): created successfully
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446f455e-9988-4a38-a3d5-7baa3e0f5b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:40:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Flow 'volume_create_manager' (89e2a8c8-5053-4249-bb11-3d54896358da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:40:07 devstack sudo[103960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:40:07 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:07 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4f6ecb17-8c00-4aa7-8440-dd2af1e97a1e tempest-SnapshotDependencyTests-453494143 None] Created volume successfully.
Sep 29 12:40:08 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.255s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "cinder-4dbb49bd-36dd-4176-af50-ed5524aceda3-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-4dbb49bd-36dd-4176-af50-ed5524aceda3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "cinder-quobyte-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-quobyte-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "cinder-quobyte-4dbb49bd-36dd-4176-af50-ed5524aceda3" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-quobyte-4dbb49bd-36dd-4176-af50-ed5524aceda3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Deleting offline snapshot 4dbb49bd-36dd-4176-af50-ed5524aceda3 of volume a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] snapshot_file for this snap is: volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3924b3a-446e-4dd6-8d2a-45712c028191]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:08 devstack sudo[103963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3
Sep 29 12:40:08 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:08 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3" returned: 0 in 0.399s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd00a1b0-e6dd-440d-890f-074c83265ae5]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:40:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:08 devstack sudo[103969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4
Sep 29 12:40:08 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:09 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4" returned: 0 in 0.548s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:09 devstack sudo[103974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3
Sep 29 12:40:09 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:09 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3" returned: 0 in 0.392s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:09 devstack sudo[103979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3
Sep 29 12:40:09 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:09 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4.4dbb49bd-36dd-4176-af50-ed5524aceda3" returned: 0 in 0.263s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-quobyte-4dbb49bd-36dd-4176-af50-ed5524aceda3" released by "_delete_snapshot" :: held 1.718s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:40:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-quobyte-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4" released by "delete_snapshot" :: held 1.750s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:40:10 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Created reservations ['8935a1fe-8c53-4803-8b0d-7040aaece21a', 'f888e111-dfa5-43fb-8928-223b9e11b38c', 'd50da6a4-6882-4bf3-99a9-3a0ff52a76be', '8444a128-88eb-4f84-8a03-6f033dde5437'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:40:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Delete snapshot completed successfully.
Sep 29 12:40:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8803ab77-8c2c-4fdd-aca6-0a4f8f228ed8 tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-4dbb49bd-36dd-4176-af50-ed5524aceda3-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:40:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "cinder-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:40:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:40:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "cinder-quobyte-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:40:10 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-quobyte-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:40:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc4405e-8cbe-4168-95ba-f1ae1d6477fe]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:40:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:10 devstack sudo[103983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4
Sep 29 12:40:10 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:10 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4" returned: 0 in 0.390s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:11 devstack sudo[103988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4
Sep 29 12:40:11 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:11 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4" returned: 0 in 0.266s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-quobyte-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4" released by "delete_volume" :: held 0.728s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Created reservations ['bf252947-0d62-4022-b676-64e706d1a255', 'beff3bd6-3c1c-490a-8493-4ac44d05dd5d', '6838af3c-713b-40ef-a269-f1e3e85bc7d7', '3fa3072d-bc44-4691-ad29-d24dfbd14e9f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:11 devstack sudo[103991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:40:11 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "cinder-830eecc7-4c97-4baa-b68f-14e8c09ac9f9-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-830eecc7-4c97-4baa-b68f-14e8c09ac9f9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:40:11 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:40:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Deleted volume successfully.
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "cinder-quobyte-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7cc8586a-069c-4551-b632-fdd91691ebbd tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-a79abe79-6cd4-4aeb-9d40-04ef30dd5cd4-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-quobyte-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd95455-27fe-41ae-b04c-fed0dc3180ab]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:40:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:11 devstack sudo[103994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9
Sep 29 12:40:11 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:12 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" returned: 0 in 0.396s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:12 devstack sudo[103999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9
Sep 29 12:40:12 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:12 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-quobyte-830eecc7-4c97-4baa-b68f-14e8c09ac9f9" released by "delete_volume" :: held 0.693s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Created reservations ['f1e58427-2351-4e49-916b-e3bc2aa3f4df', 'dcf05580-821b-4809-8a11-ec71ffe67b69', '40109212-3cd1-40f6-8e79-89cf41374ed5', '670563f8-daaf-4bfa-add3-178c1199d354'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:12 devstack sudo[104002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:40:12 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:12 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.266s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:40:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Deleted volume successfully.
Sep 29 12:40:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-297379a0-51ee-41c0-a085-26e63a67a718 tempest-SnapshotDependencyTests-453494143 None] Lock "cinder-830eecc7-4c97-4baa-b68f-14e8c09ac9f9-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:40:22 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=54,cinder:INSERT=14,cinder:UPDATE=52,cinder:DELETE=4 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:40:22 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=49,cinder:UPDATE=56,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:40:40 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Flow 'volume_create_manager' (78243130-6ca0-4a7f-bd0c-891ef16d1cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09732726-0638-4505-85b7-99d270e83e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09732726-0638-4505-85b7-99d270e83e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-509152148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1dc2e0-bc15-4065-8717-b8c89447c306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acc55b5a753e4a4b883526dae381398a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:41Z,use_quota=True,user_id='ece32918f9134d2d978bda6e7837f7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6939210-864f-487f-9e36-9333c8f82e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6939210-864f-487f-9e36-9333c8f82e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3294658-74b8-40fa-ac07-96391f8de380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3294658-74b8-40fa-ac07-96391f8de380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b1dc2e0-bc15-4065-8717-b8c89447c306', 'volume_name': 'volume-2b1dc2e0-bc15-4065-8717-b8c89447c306', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0608dc2-d7c2-45d9-9fb9-99ad0e25c537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0608dc2-d7c2-45d9-9fb9-99ad0e25c537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58f517f-1165-4548-8d59-8c5410fe9896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:40:41 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Volume 2b1dc2e0-bc15-4065-8717-b8c89447c306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b1dc2e0-bc15-4065-8717-b8c89447c306', 'volume_size': 1}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-509152148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1dc2e0-bc15-4065-8717-b8c89447c306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acc55b5a753e4a4b883526dae381398a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:40:41Z,use_quota=True,user_id='ece32918f9134d2d978bda6e7837f7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Creating volume 2b1dc2e0-bc15-4065-8717-b8c89447c306 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:40:41 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:41 devstack sudo[104015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 1073741824
Sep 29 12:40:41 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:41 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 1073741824" returned: 0 in 0.498s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:40:41 devstack sudo[104021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306
Sep 29 12:40:41 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:40:41 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306" returned: 0 in 0.320s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58f517f-1165-4548-8d59-8c5410fe9896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b1dc2e0-bc15-4065-8717-b8c89447c306', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:40:41 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a495f70-deec-4294-9393-9cdbeaf6f70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:40:41 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Volume volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 (2b1dc2e0-bc15-4065-8717-b8c89447c306): created successfully
Sep 29 12:40:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a495f70-deec-4294-9393-9cdbeaf6f70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:40:42 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Flow 'volume_create_manager' (78243130-6ca0-4a7f-bd0c-891ef16d1cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:40:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4f7d2e4f-7788-4aad-98d2-9fc0db1d6def tempest-TestStampPattern-1321221307 None] Created volume successfully.
Sep 29 12:40:52 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:40:52 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:41:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:41:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:41:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:41:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:41:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:41:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:41:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:41:07 devstack sudo[104192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:41:07 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:41:08 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root
Sep 29 12:41:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:41:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:41:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:41:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:41:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:41:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-0afd5799-6c9a-477f-939f-2cb28d7a8fdd req-2bd6f051-c409-4a55-b0ee-5bac7afbe361 tempest-TestStampPattern-1321221307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:41:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-0afd5799-6c9a-477f-939f-2cb28d7a8fdd req-2bd6f051-c409-4a55-b0ee-5bac7afbe361 tempest-TestStampPattern-1321221307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:41:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-0afd5799-6c9a-477f-939f-2cb28d7a8fdd req-2bd6f051-c409-4a55-b0ee-5bac7afbe361 tempest-TestStampPattern-1321221307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:41:11 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-0afd5799-6c9a-477f-939f-2cb28d7a8fdd req-2bd6f051-c409-4a55-b0ee-5bac7afbe361 tempest-TestStampPattern-1321221307 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-2b1dc2e0-bc15-4065-8717-b8c89447c306', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4671788-0b66-4e35-925c-9f5b03863109', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:41:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-0afd5799-6c9a-477f-939f-2cb28d7a8fdd req-2bd6f051-c409-4a55-b0ee-5bac7afbe361 tempest-TestStampPattern-1321221307 None] attachment_update completed successfully.
Sep 29 12:41:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-774ac94d-466d-4d08-90e4-77f8bbea3ed3 req-46eaabc5-977c-4ea1-baea-db8ed6683552 tempest-TestStampPattern-1321221307 None] Terminate volume connection completed successfully.
Sep 29 12:41:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-774ac94d-466d-4d08-90e4-77f8bbea3ed3 req-46eaabc5-977c-4ea1-baea-db8ed6683552 tempest-TestStampPattern-1321221307 None] Deleting attachment d4671788-0b66-4e35-925c-9f5b03863109. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:41:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:41:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:41:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] Creating offline snapshot cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 of volume 2b1dc2e0-bc15-4065-8717-b8c89447c306 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:41:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec6dd84-02b2-454e-9713-4842461ede65]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:41:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:41:17 devstack sudo[104681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306
Sep 29 12:41:17 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:41:18 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root
Sep 29 12:41:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306" returned: 0 in 0.390s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:41:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:41:18 devstack sudo[104686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 1G
Sep 29 12:41:18 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:41:18 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root
Sep 29 12:41:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 1G" returned: 0 in 0.449s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:41:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:41:18 devstack sudo[104692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14
Sep 29 12:41:18 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:41:18 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root
Sep 29 12:41:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:41:18 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 is being set with open permissions: ugo+rw
Sep 29 12:41:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:41:18 devstack sudo[104697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14
Sep 29 12:41:18 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:41:19 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root
Sep 29 12:41:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14" returned: 0 in 0.255s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:41:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:41:19 devstack sudo[104700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.info
Sep 29 12:41:19 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:41:19 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root
Sep 29 12:41:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.info" returned: 0 in 0.257s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:41:19 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.info is being set with open permissions: ugo+rw
Sep 29 12:41:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:41:19 devstack sudo[104703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.info
Sep 29 12:41:19 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:41:19 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root
Sep 29 12:41:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.info" returned: 0 in 0.241s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:41:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:41:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f80d87c8-c042-4a56-82cd-a98593de3ba3 tempest-TestStampPattern-1321221307 None] Create snapshot completed successfully
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Flow 'volume_create_manager' (a34b0900-36f4-453a-9771-ed7bcf764d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e8c769-5589-457e-917b-8873b13c248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e8c769-5589-457e-917b-8873b13c248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1319293547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa7769b-7ace-4bc4-bed4-33f7a8493edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acc55b5a753e4a4b883526dae381398a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc3a50e5-0c87-4ae1-8852-d7a7221d5e14,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:41:27Z,use_quota=True,user_id='ece32918f9134d2d978bda6e7837f7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c21f4a3-4866-4477-8f2f-a77b2df95afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c21f4a3-4866-4477-8f2f-a77b2df95afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d086a68-3b94-4c03-97a7-87746c905910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d086a68-3b94-4c03-97a7-87746c905910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7fa7769b-7ace-4bc4-bed4-33f7a8493edd', 'volume_name': 'volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd', 'volume_size': 1, 'snapshot_id': 'cc3a50e5-0c87-4ae1-8852-d7a7221d5e14'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20368d1f-42c8-4b6d-a301-d76ecb300174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20368d1f-42c8-4b6d-a301-d76ecb300174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527d3594-889f-4e05-9a61-a58419fa513d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:41:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Volume 7fa7769b-7ace-4bc4-bed4-33f7a8493edd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd', 'volume_size': 1, 'snapshot_id': 'cc3a50e5-0c87-4ae1-8852-d7a7221d5e14'}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Acquiring lock "cinder-quobyte-cc3a50e5-0c87-4ae1-8852-d7a7221d5e14-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Lock "cinder-quobyte-cc3a50e5-0c87-4ae1-8852-d7a7221d5e14-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Creating volume 7fa7769b-7ace-4bc4-bed4-33f7a8493edd from snapshot cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Acquiring lock "cinder-quobyte-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Lock "cinder-quobyte-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] snapshot: cc3a50e5-0c87-4ae1-8852-d7a7221d5e14, volume: 7fa7769b-7ace-4bc4-bed4-33f7a8493edd,  {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2abf572-bbaf-4bbe-a728-f3e7462e3934]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:41:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:41:26 devstack sudo[104744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14
Sep 29 12:41:26 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:41:27 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root
Sep 29 12:41:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14" returned: 0 in 0.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:41:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b1dc2e0-bc15-4065-8717-b8c89447c306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:41:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[224e93a5-3874-4498-be61-d7466239b6a0]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:41:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:41:27 devstack sudo[104749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306
Sep 29 12:41:27 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:41:27 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root
Sep 29 12:41:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306" returned: 0 in 0.453s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:41:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 12:41:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 12:41:27 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Path /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 12:41:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:41:27 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd
Sep 29 12:41:27 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:41:36 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Sep 29 12:41:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" returned: 0 in 8.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:41:36 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:41:36 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Converted 1024.00 MB image at 120.88 MB/s
Sep 29 12:41:36 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd is being set with open permissions: ugo+rw
Sep 29 12:41:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:41:36 devstack sudo[104838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd
Sep 29 12:41:36 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:41:36 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root
Sep 29 12:41:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" returned: 0 in 0.262s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:41:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Lock "cinder-quobyte-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" released by "_copy_volume_from_snapshot" :: held 9.717s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:41:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Lock "cinder-quobyte-cc3a50e5-0c87-4ae1-8852-d7a7221d5e14-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" released by "_create_volume_from_snapshot" :: held 9.802s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:41:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.819s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:41:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527d3594-889f-4e05-9a61-a58419fa513d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd', 'volume_size': 1, 'snapshot_id': 'cc3a50e5-0c87-4ae1-8852-d7a7221d5e14'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:41:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ec2c0f-4c84-4bfe-b484-9f41de5b05b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:41:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Volume volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd (7fa7769b-7ace-4bc4-bed4-33f7a8493edd): created successfully
Sep 29 12:41:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ec2c0f-4c84-4bfe-b484-9f41de5b05b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:41:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Flow 'volume_create_manager' (a34b0900-36f4-453a-9771-ed7bcf764d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:41:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7bb27077-d823-43a0-8018-72cf702c0bc6 tempest-TestStampPattern-1321221307 None] Created volume successfully.
Sep 29 12:41:46 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:41:46 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:42:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:42:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:42:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:42:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:42:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:42:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:42:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:07 devstack sudo[104919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:42:07 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:08 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.280s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:42:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:42:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:42:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:42:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-4e233913-c10b-4bde-bc78-eaa6a849197d req-28fb5337-95e8-46f5-bf40-7681b4bef2a8 tempest-TestStampPattern-1321221307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:42:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-4e233913-c10b-4bde-bc78-eaa6a849197d req-28fb5337-95e8-46f5-bf40-7681b4bef2a8 tempest-TestStampPattern-1321221307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:42:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [req-4e233913-c10b-4bde-bc78-eaa6a849197d req-28fb5337-95e8-46f5-bf40-7681b4bef2a8 tempest-TestStampPattern-1321221307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:42:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-4e233913-c10b-4bde-bc78-eaa6a849197d req-28fb5337-95e8-46f5-bf40-7681b4bef2a8 tempest-TestStampPattern-1321221307 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4', 'name': 'volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1b735ba-9764-4132-a184-ebbcc052af09', 'enforce_multipath': True} {{(pid=86369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 12:42:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-4e233913-c10b-4bde-bc78-eaa6a849197d req-28fb5337-95e8-46f5-bf40-7681b4bef2a8 tempest-TestStampPattern-1321221307 None] attachment_update completed successfully.
Sep 29 12:42:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [req-75c8d8c6-b7d8-4ce4-8102-e6995e756ab5 req-1695fe3b-446a-4eaf-b844-f80b11a2ac69 tempest-TestStampPattern-1321221307 None] Terminate volume connection completed successfully.
Sep 29 12:42:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [req-75c8d8c6-b7d8-4ce4-8102-e6995e756ab5 req-1695fe3b-446a-4eaf-b844-f80b11a2ac69 tempest-TestStampPattern-1321221307 None] Deleting attachment d1b735ba-9764-4132-a184-ebbcc052af09. {{(pid=86369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 12:42:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Acquiring lock "cinder-7fa7769b-7ace-4bc4-bed4-33f7a8493edd-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:42:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Lock "cinder-7fa7769b-7ace-4bc4-bed4-33f7a8493edd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:42:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Acquiring lock "cinder-quobyte-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:42:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Lock "cinder-quobyte-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:42:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c465445-8d09-4346-bfce-7ae961246f2e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:42:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:24 devstack sudo[105446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd
Sep 29 12:42:24 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:25 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" returned: 0 in 0.372s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:25 devstack sudo[105451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd
Sep 29 12:42:25 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:25 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" returned: 0 in 0.252s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Lock "cinder-quobyte-7fa7769b-7ace-4bc4-bed4-33f7a8493edd" released by "delete_volume" :: held 0.667s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Created reservations ['6e0283f1-5cbd-4364-b768-70380acd234f', '541ba9dc-ef1a-472b-8a56-3d2d290abd71', '5fff7a2d-8796-4967-a7c7-5ab476ab3213', 'ae54636e-1da7-4071-a2d7-08c05f4eface'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:25 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:42:25 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:25 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.241s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:42:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Deleted volume successfully.
Sep 29 12:42:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-18cd8c8e-dbfd-484c-89b2-f7ceb333bf63 tempest-TestStampPattern-1321221307 None] Lock "cinder-7fa7769b-7ace-4bc4-bed4-33f7a8493edd-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Acquiring lock "cinder-cc3a50e5-0c87-4ae1-8852-d7a7221d5e14-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Lock "cinder-cc3a50e5-0c87-4ae1-8852-d7a7221d5e14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Acquiring lock "cinder-quobyte-2b1dc2e0-bc15-4065-8717-b8c89447c306" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Lock "cinder-quobyte-2b1dc2e0-bc15-4065-8717-b8c89447c306" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Acquiring lock "cinder-quobyte-cc3a50e5-0c87-4ae1-8852-d7a7221d5e14" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Lock "cinder-quobyte-cc3a50e5-0c87-4ae1-8852-d7a7221d5e14" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Deleting offline snapshot cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 of volume 2b1dc2e0-bc15-4065-8717-b8c89447c306 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] snapshot_file for this snap is: volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aed1f0-148f-4ead-96d2-affc5e33e2c9]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:26 devstack sudo[105459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14
Sep 29 12:42:26 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:26 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14" returned: 0 in 0.354s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b1dc2e0-bc15-4065-8717-b8c89447c306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e86ff8-4914-40a9-8be8-5b9723aec70f]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:42:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:26 devstack sudo[105464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306
Sep 29 12:42:26 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:27 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306" returned: 0 in 0.550s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:27 devstack sudo[105469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14
Sep 29 12:42:27 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:27 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14" returned: 0 in 0.328s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:27 devstack sudo[105475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14
Sep 29 12:42:27 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:27 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306.cc3a50e5-0c87-4ae1-8852-d7a7221d5e14" returned: 0 in 0.240s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Lock "cinder-quobyte-cc3a50e5-0c87-4ae1-8852-d7a7221d5e14" released by "_delete_snapshot" :: held 1.577s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:42:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Lock "cinder-quobyte-2b1dc2e0-bc15-4065-8717-b8c89447c306" released by "delete_snapshot" :: held 1.599s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:42:27 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Created reservations ['84f0cfcd-b430-4606-97fa-0f79ae089d16', 'af17a832-cd87-433f-bb0d-99d032322769', '298f8d3d-e8b1-4ceb-aedb-40e1c1e83e48', 'ed92a0eb-2973-4804-8d35-e493284ddc69'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:42:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Delete snapshot completed successfully.
Sep 29 12:42:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6d38444d-4329-4a30-8e63-f067e760f2ba tempest-TestStampPattern-1321221307 None] Lock "cinder-cc3a50e5-0c87-4ae1-8852-d7a7221d5e14-delete_snapshot" released by "delete_snapshot" :: held 1.750s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:42:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Acquiring lock "cinder-2b1dc2e0-bc15-4065-8717-b8c89447c306-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:42:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Lock "cinder-2b1dc2e0-bc15-4065-8717-b8c89447c306-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:42:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Acquiring lock "cinder-quobyte-2b1dc2e0-bc15-4065-8717-b8c89447c306" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:42:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Lock "cinder-quobyte-2b1dc2e0-bc15-4065-8717-b8c89447c306" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:42:31 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1dbc29-6104-4ae8-b570-dfd5cfbc0c28]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:42:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:31 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306
Sep 29 12:42:31 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:32 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306" returned: 0 in 0.399s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:32 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306
Sep 29 12:42:32 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:32 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2b1dc2e0-bc15-4065-8717-b8c89447c306" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Lock "cinder-quobyte-2b1dc2e0-bc15-4065-8717-b8c89447c306" released by "delete_volume" :: held 0.741s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Created reservations ['05fe770c-9d80-4538-9ee2-7c352b23a453', '557a977f-0465-4b95-a5d0-3d52c65aba6f', '43eeb695-5926-4a31-9a93-c3d4bfa4d175', 'd4069b91-be98-4393-93d8-8a55927d2d0c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:32 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:42:32 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:32 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.270s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:42:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Deleted volume successfully.
Sep 29 12:42:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-17e6eb59-f77d-4f1d-aedf-65a2076b036e tempest-TestStampPattern-1321221307 None] Lock "cinder-2b1dc2e0-bc15-4065-8717-b8c89447c306-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:42:42 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=21,cinder:UPDATE=25,cinder:INSERT=5 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:42:42 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=22,cinder:SELECT=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Flow 'volume_create_manager' (9f72930d-80ae-446a-8dba-8360df5fd287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a5d7e0-442b-4a02-b920-4020cabdef01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a5d7e0-442b-4a02-b920-4020cabdef01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-702567151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db94328f-ff02-4527-8e73-507498ee37dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ff5096abbf4161989e8dc8cba5a845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:45Z,use_quota=True,user_id='5319e60bdd844f10bd5a150a924705d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d204fad-dd18-41bc-8fdd-c1912718a6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d204fad-dd18-41bc-8fdd-c1912718a6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5036e840-d489-428c-9528-752a78108864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5036e840-d489-428c-9528-752a78108864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db94328f-ff02-4527-8e73-507498ee37dd', 'volume_name': 'volume-db94328f-ff02-4527-8e73-507498ee37dd', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a106baa0-378c-4b34-87e0-31faa57875c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a106baa0-378c-4b34-87e0-31faa57875c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318ec9f4-9a6d-4f70-9361-50ecdedfa43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:42:44 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Volume db94328f-ff02-4527-8e73-507498ee37dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db94328f-ff02-4527-8e73-507498ee37dd', 'volume_size': 1}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-702567151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db94328f-ff02-4527-8e73-507498ee37dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ff5096abbf4161989e8dc8cba5a845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:45Z,use_quota=True,user_id='5319e60bdd844f10bd5a150a924705d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Creating volume db94328f-ff02-4527-8e73-507498ee37dd {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:42:44 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:42:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-db94328f-ff02-4527-8e73-507498ee37dd 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:44 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-db94328f-ff02-4527-8e73-507498ee37dd 1073741824
Sep 29 12:42:44 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:45 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-db94328f-ff02-4527-8e73-507498ee37dd 1073741824" returned: 0 in 0.433s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-db94328f-ff02-4527-8e73-507498ee37dd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:45 devstack sudo[105531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-db94328f-ff02-4527-8e73-507498ee37dd
Sep 29 12:42:45 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:45 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-db94328f-ff02-4527-8e73-507498ee37dd" returned: 0 in 0.245s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:42:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:42:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318ec9f4-9a6d-4f70-9361-50ecdedfa43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db94328f-ff02-4527-8e73-507498ee37dd', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:42:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ec8333-de80-43cc-b278-4107773cf6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:42:45 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Volume volume-db94328f-ff02-4527-8e73-507498ee37dd (db94328f-ff02-4527-8e73-507498ee37dd): created successfully
Sep 29 12:42:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ec8333-de80-43cc-b278-4107773cf6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:42:45 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Flow 'volume_create_manager' (9f72930d-80ae-446a-8dba-8360df5fd287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:42:45 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d9b30627-68ac-4485-ae16-855f10e84b73 tempest-ProjectReaderTests-2107970555 None] Created volume successfully.
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Acquiring lock "cinder-db94328f-ff02-4527-8e73-507498ee37dd-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Lock "cinder-db94328f-ff02-4527-8e73-507498ee37dd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Acquiring lock "cinder-quobyte-db94328f-ff02-4527-8e73-507498ee37dd" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Lock "cinder-quobyte-db94328f-ff02-4527-8e73-507498ee37dd" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b1c052-2058-4de9-9f11-45606f32f824]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-db94328f-ff02-4527-8e73-507498ee37dd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:46 devstack sudo[105535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-db94328f-ff02-4527-8e73-507498ee37dd
Sep 29 12:42:46 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:46 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-db94328f-ff02-4527-8e73-507498ee37dd" returned: 0 in 0.382s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-db94328f-ff02-4527-8e73-507498ee37dd {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:46 devstack sudo[105540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-db94328f-ff02-4527-8e73-507498ee37dd
Sep 29 12:42:46 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:46 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-db94328f-ff02-4527-8e73-507498ee37dd" returned: 0 in 0.247s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Lock "cinder-quobyte-db94328f-ff02-4527-8e73-507498ee37dd" released by "delete_volume" :: held 0.672s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Created reservations ['bd1d7bb3-1bd0-4dd4-a593-799fa54b9bdf', 'cdba2b05-a7cb-43cd-b205-44c3e6df3885', 'c0c3c444-3587-45d4-bf90-43a1529ab00a', 'b828f837-826e-4f7e-8d6d-5b0797c86a4c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:42:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:46 devstack sudo[105543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:42:46 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:47 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:42:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Deleted volume successfully.
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4e789beb-b1d0-4b32-9602-adad8b58022e tempest-ProjectReaderTests-2107970555 None] Lock "cinder-db94328f-ff02-4527-8e73-507498ee37dd-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Flow 'volume_create_manager' (7bc25cf9-1e06-400a-b705-8eb2de5e678f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85179ea-1aee-46e6-bfe7-5236e2d41b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85179ea-1aee-46e6-bfe7-5236e2d41b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-970007202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae45926a-6a05-4452-9ba1-c2d8e6ab939b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ff5096abbf4161989e8dc8cba5a845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:48Z,use_quota=True,user_id='5319e60bdd844f10bd5a150a924705d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e507a1-5e13-4b40-b8b9-881971f67cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e507a1-5e13-4b40-b8b9-881971f67cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61091e3e-4e22-43f4-8eae-ea66803b7695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61091e3e-4e22-43f4-8eae-ea66803b7695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae45926a-6a05-4452-9ba1-c2d8e6ab939b', 'volume_name': 'volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7db09b-418c-4a14-94ec-38e0e1b46a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7db09b-418c-4a14-94ec-38e0e1b46a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5d9911-3e5f-49dc-ae53-00e7730e27af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:42:47 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Volume ae45926a-6a05-4452-9ba1-c2d8e6ab939b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b', 'volume_size': 1}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-970007202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae45926a-6a05-4452-9ba1-c2d8e6ab939b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ff5096abbf4161989e8dc8cba5a845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:42:48Z,use_quota=True,user_id='5319e60bdd844f10bd5a150a924705d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Creating volume ae45926a-6a05-4452-9ba1-c2d8e6ab939b {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:42:47 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:42:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:47 devstack sudo[105546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b 1073741824
Sep 29 12:42:47 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:48 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b 1073741824" returned: 0 in 0.469s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:48 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b
Sep 29 12:42:48 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:48 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:42:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:42:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5d9911-3e5f-49dc-ae53-00e7730e27af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:42:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe5c494-04b9-41a9-8894-4c6c5554c93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:42:48 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Volume volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b (ae45926a-6a05-4452-9ba1-c2d8e6ab939b): created successfully
Sep 29 12:42:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe5c494-04b9-41a9-8894-4c6c5554c93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:42:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Flow 'volume_create_manager' (7bc25cf9-1e06-400a-b705-8eb2de5e678f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:42:48 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8f903991-bb82-40a2-a41b-2e0b7ab79980 tempest-ProjectReaderTests-2107970555 None] Created volume successfully.
Sep 29 12:42:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Acquiring lock "cinder-ae45926a-6a05-4452-9ba1-c2d8e6ab939b-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:42:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Lock "cinder-ae45926a-6a05-4452-9ba1-c2d8e6ab939b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:42:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Acquiring lock "cinder-quobyte-ae45926a-6a05-4452-9ba1-c2d8e6ab939b" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:42:49 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Lock "cinder-quobyte-ae45926a-6a05-4452-9ba1-c2d8e6ab939b" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:42:49 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[160cb0e7-5cc6-4a0e-a7be-761977407232]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:42:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:50 devstack sudo[105555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b
Sep 29 12:42:50 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:50 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:50 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b
Sep 29 12:42:50 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:50 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ae45926a-6a05-4452-9ba1-c2d8e6ab939b" returned: 0 in 0.250s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Lock "cinder-quobyte-ae45926a-6a05-4452-9ba1-c2d8e6ab939b" released by "delete_volume" :: held 0.690s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Created reservations ['5035e182-f519-4364-bbff-8e0d9495f059', '58cc837f-de1b-4eeb-aed0-f037d23ebb33', '9d810d19-ec62-429a-83f0-478ca68ab202', 'f78f82d5-c96c-4c52-976e-dcf8f1079287'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:42:50 devstack sudo[105563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:42:50 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:42:50 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.284s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:42:50 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:42:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Deleted volume successfully.
Sep 29 12:42:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-81b6b339-9891-4840-96df-fb44da32969b tempest-ProjectReaderTests-2107970555 None] Lock "cinder-ae45926a-6a05-4452-9ba1-c2d8e6ab939b-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:00 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=22,cinder:SELECT=15,cinder:INSERT=6 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:43:01 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=22,cinder:DELETE=4 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Flow 'volume_create_manager' (a89afbbb-ad9d-4554-955c-4973b1e01aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17ac32b-e3bf-4832-bf47-4be9d9ee56a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17ac32b-e3bf-4832-bf47-4be9d9ee56a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1240088320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14550216-0167-4dc1-8fcd-ae2d94f15dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9325d1be6774286bffe57ee0e6c52fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:04Z,use_quota=True,user_id='2dfecc29d4c64fb68b038f7cd489bad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5722bf4-639a-4688-b804-bead8afa959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5722bf4-639a-4688-b804-bead8afa959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5483c68f-361e-4385-828b-2ff15cfa1741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5483c68f-361e-4385-828b-2ff15cfa1741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14550216-0167-4dc1-8fcd-ae2d94f15dea', 'volume_name': 'volume-14550216-0167-4dc1-8fcd-ae2d94f15dea', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb48cb9-da05-4441-a4f4-8eb24328d4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb48cb9-da05-4441-a4f4-8eb24328d4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de2ff26-8ee2-4659-9983-e8d062a8efaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:03 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume 14550216-0167-4dc1-8fcd-ae2d94f15dea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14550216-0167-4dc1-8fcd-ae2d94f15dea', 'volume_size': 1}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1240088320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14550216-0167-4dc1-8fcd-ae2d94f15dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9325d1be6774286bffe57ee0e6c52fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:04Z,use_quota=True,user_id='2dfecc29d4c64fb68b038f7cd489bad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Creating volume 14550216-0167-4dc1-8fcd-ae2d94f15dea {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:03 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14550216-0167-4dc1-8fcd-ae2d94f15dea 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:03 devstack sudo[105645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14550216-0167-4dc1-8fcd-ae2d94f15dea 1073741824
Sep 29 12:43:03 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Flow 'volume_create_manager' (d817a35d-aaa8-45aa-ac0e-3d7595d13d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42308322-287d-45ec-865e-c3a85d7b5e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42308322-287d-45ec-865e-c3a85d7b5e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-679530374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cc46d4-d773-46ae-a3ce-49c07f1a6960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063b151c3294bbba5f63b879b19bb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:04Z,use_quota=True,user_id='b95cf97506d84e2c910aae03f6d08350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23087f64-70c8-4f82-916a-772eb56253b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23087f64-70c8-4f82-916a-772eb56253b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d167ba-d957-4c00-9c95-0d848b56efb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d167ba-d957-4c00-9c95-0d848b56efb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99cc46d4-d773-46ae-a3ce-49c07f1a6960', 'volume_name': 'volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1dc64ee-db58-4aa2-b575-b275021fbb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1dc64ee-db58-4aa2-b575-b275021fbb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89b52c5-9f8b-43f3-80f3-1130d1218755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume 99cc46d4-d773-46ae-a3ce-49c07f1a6960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960', 'volume_size': 1}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:04 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14550216-0167-4dc1-8fcd-ae2d94f15dea 1073741824" returned: 0 in 0.544s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14550216-0167-4dc1-8fcd-ae2d94f15dea {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:04 devstack sudo[105650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14550216-0167-4dc1-8fcd-ae2d94f15dea
Sep 29 12:43:04 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:04 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14550216-0167-4dc1-8fcd-ae2d94f15dea" returned: 0 in 0.315s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-679530374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cc46d4-d773-46ae-a3ce-49c07f1a6960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063b151c3294bbba5f63b879b19bb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:04Z,use_quota=True,user_id='b95cf97506d84e2c910aae03f6d08350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Creating volume 99cc46d4-d773-46ae-a3ce-49c07f1a6960 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:04 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de2ff26-8ee2-4659-9983-e8d062a8efaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14550216-0167-4dc1-8fcd-ae2d94f15dea', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:04 devstack sudo[105654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960 1073741824
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b5e83b-3ec5-4133-9a48-b992bafe1257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:04 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume volume-14550216-0167-4dc1-8fcd-ae2d94f15dea (14550216-0167-4dc1-8fcd-ae2d94f15dea): created successfully
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b5e83b-3ec5-4133-9a48-b992bafe1257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Flow 'volume_create_manager' (a89afbbb-ad9d-4554-955c-4973b1e01aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:04 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-299e1ebf-0ddd-4576-919f-2dcf613a2197 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Created volume successfully.
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (2bc85791-2c4c-44b3-bbfd-435f146a0eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c62471-c7a1-4e21-9338-3fc22965b4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c62471-c7a1-4e21-9338-3fc22965b4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1338927739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099290bf-efdf-4620-86cb-c4459bb1a840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:05Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e74e6b-5b8b-447e-9fcf-aa6b529d1158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e74e6b-5b8b-447e-9fcf-aa6b529d1158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20012a00-123f-4e28-b96a-2ef8c508454a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20012a00-123f-4e28-b96a-2ef8c508454a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '099290bf-efdf-4620-86cb-c4459bb1a840', 'volume_name': 'volume-099290bf-efdf-4620-86cb-c4459bb1a840', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc2c238-5bfb-4746-b6eb-182308c731c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc2c238-5bfb-4746-b6eb-182308c731c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32425f3-e6b9-4097-9976-50337b7356eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Volume 099290bf-efdf-4620-86cb-c4459bb1a840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-099290bf-efdf-4620-86cb-c4459bb1a840', 'volume_size': 1}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:05 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960 1073741824" returned: 0 in 0.482s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:05 devstack sudo[105661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960
Sep 29 12:43:05 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:05 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1338927739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099290bf-efdf-4620-86cb-c4459bb1a840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:05Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Creating volume 099290bf-efdf-4620-86cb-c4459bb1a840 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:05 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:05 devstack sudo[105664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840 1073741824
Sep 29 12:43:05 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89b52c5-9f8b-43f3-80f3-1130d1218755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb94441-dc27-46e1-bb2e-282546b9e726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960 (99cc46d4-d773-46ae-a3ce-49c07f1a6960): created successfully
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb94441-dc27-46e1-bb2e-282546b9e726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Flow 'volume_create_manager' (d817a35d-aaa8-45aa-ac0e-3d7595d13d95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3f1c065f-8fbf-4dc4-84b7-84f8fb067d11 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created volume successfully.
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Flow 'volume_create_manager' (7c7050d4-b551-4cbe-a9a4-b3b2c49b7f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dc3924-b5c7-4e44-a46a-c757fb82d104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:06 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840 1073741824" returned: 0 in 0.678s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dc3924-b5c7-4e44-a46a-c757fb82d104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-93113019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545b56c4-e65c-448b-b400-db8a9858a13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9325d1be6774286bffe57ee0e6c52fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:06Z,use_quota=True,user_id='2dfecc29d4c64fb68b038f7cd489bad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8b7bbc-41ee-4fac-a6a3-3ed6c53f68c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8b7bbc-41ee-4fac-a6a3-3ed6c53f68c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3088cc-1b1a-4edc-bd7d-4eff87750a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3088cc-1b1a-4edc-bd7d-4eff87750a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '545b56c4-e65c-448b-b400-db8a9858a13b', 'volume_name': 'volume-545b56c4-e65c-448b-b400-db8a9858a13b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040664ae-a58f-441f-8127-bd2ed868def9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040664ae-a58f-441f-8127-bd2ed868def9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb91bf6a-ac2c-4ea2-8076-566aba2f669b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume 545b56c4-e65c-448b-b400-db8a9858a13b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-545b56c4-e65c-448b-b400-db8a9858a13b', 'volume_size': 1}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:06 devstack sudo[105669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840
Sep 29 12:43:06 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Flow 'volume_create_manager' (0eb7f9ff-a611-44ab-b87f-e504de113191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8f8783-9e83-41f7-8f73-01d0ab414ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8f8783-9e83-41f7-8f73-01d0ab414ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029360399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbaf6af-8cca-4a99-8857-3bb03e7e6855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9325d1be6774286bffe57ee0e6c52fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:07Z,use_quota=True,user_id='2dfecc29d4c64fb68b038f7cd489bad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495dd106-3663-4ffa-b197-ea3be6e251f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495dd106-3663-4ffa-b197-ea3be6e251f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:06 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350e4ca1-4777-4ce7-995a-ede272d07b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350e4ca1-4777-4ce7-995a-ede272d07b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dbaf6af-8cca-4a99-8857-3bb03e7e6855', 'volume_name': 'volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272bf8c1-f5c5-4d73-852e-99c5994774a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272bf8c1-f5c5-4d73-852e-99c5994774a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fc6760-20ba-45a1-bcd0-aa9b632ee010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume 0dbaf6af-8cca-4a99-8857-3bb03e7e6855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855', 'volume_size': 1}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840" returned: 0 in 0.392s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.431s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-93113019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545b56c4-e65c-448b-b400-db8a9858a13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9325d1be6774286bffe57ee0e6c52fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:06Z,use_quota=True,user_id='2dfecc29d4c64fb68b038f7cd489bad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Creating volume 545b56c4-e65c-448b-b400-db8a9858a13b {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:06 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-545b56c4-e65c-448b-b400-db8a9858a13b 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32425f3-e6b9-4097-9976-50337b7356eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-099290bf-efdf-4620-86cb-c4459bb1a840', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5f03f0-a354-42fc-a32c-32e11fa1ac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:06 devstack sudo[105672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-545b56c4-e65c-448b-b400-db8a9858a13b 1073741824
Sep 29 12:43:06 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Volume volume-099290bf-efdf-4620-86cb-c4459bb1a840 (099290bf-efdf-4620-86cb-c4459bb1a840): created successfully
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5f03f0-a354-42fc-a32c-32e11fa1ac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (2bc85791-2c4c-44b3-bbfd-435f146a0eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c6b420f4-515b-4ef7-a27c-dbb0e94d38c0 tempest-ProjectMemberTests-222694199 None] Created volume successfully.
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Flow 'volume_create_manager' (baba1e8a-44c0-4433-bdd1-616062304d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8712a3e1-b457-43c1-95a5-31423130f62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8712a3e1-b457-43c1-95a5-31423130f62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557249052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c31b00-ea32-4deb-8d7b-2f2e08e0e3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9325d1be6774286bffe57ee0e6c52fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:07Z,use_quota=True,user_id='2dfecc29d4c64fb68b038f7cd489bad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cd78c9-61a6-4f9c-8a16-d55627c56bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cd78c9-61a6-4f9c-8a16-d55627c56bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db889c8-e148-48d9-bed8-22091fb1c0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db889c8-e148-48d9-bed8-22091fb1c0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c31b00-ea32-4deb-8d7b-2f2e08e0e3db', 'volume_name': 'volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9070446-c4c1-4d94-8ed8-516465322844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9070446-c4c1-4d94-8ed8-516465322844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b282a54c-d54f-4d44-ba0d-6111751322d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:07 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume 98c31b00-ea32-4deb-8d7b-2f2e08e0e3db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db', 'volume_size': 1}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:07 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-545b56c4-e65c-448b-b400-db8a9858a13b 1073741824" returned: 0 in 0.839s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-545b56c4-e65c-448b-b400-db8a9858a13b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:07 devstack sudo[105680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-545b56c4-e65c-448b-b400-db8a9858a13b
Sep 29 12:43:07 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:07 devstack sudo[105682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:07 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:08 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-545b56c4-e65c-448b-b400-db8a9858a13b" returned: 0 in 0.458s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029360399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbaf6af-8cca-4a99-8857-3bb03e7e6855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9325d1be6774286bffe57ee0e6c52fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:07Z,use_quota=True,user_id='2dfecc29d4c64fb68b038f7cd489bad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Creating volume 0dbaf6af-8cca-4a99-8857-3bb03e7e6855 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:08 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb91bf6a-ac2c-4ea2-8076-566aba2f669b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-545b56c4-e65c-448b-b400-db8a9858a13b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:08 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:08 devstack sudo[105688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855 1073741824
Sep 29 12:43:08 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24893c7e-a1ea-4aa3-9bbd-01299906f579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.433s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:08 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume volume-545b56c4-e65c-448b-b400-db8a9858a13b (545b56c4-e65c-448b-b400-db8a9858a13b): created successfully
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24893c7e-a1ea-4aa3-9bbd-01299906f579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Flow 'volume_create_manager' (7c7050d4-b551-4cbe-a9a4-b3b2c49b7f0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:43:08 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-db822511-1cbd-49fd-a942-ba39d36e4a25 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Created volume successfully.
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Flow 'volume_create_manager' (d99c7407-3c71-47b3-b803-ea079a95e029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319fb0cc-1aa3-4b65-9e5d-141e41e7afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319fb0cc-1aa3-4b65-9e5d-141e41e7afc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371638584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9b87be-6105-4c40-b0aa-489e7ade9044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9325d1be6774286bffe57ee0e6c52fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:08Z,use_quota=True,user_id='2dfecc29d4c64fb68b038f7cd489bad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cada18c4-8608-49fa-b7d9-a18f6a6eabf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cada18c4-8608-49fa-b7d9-a18f6a6eabf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c39672-109f-4aa7-b3ac-2ce5d70abfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c39672-109f-4aa7-b3ac-2ce5d70abfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc9b87be-6105-4c40-b0aa-489e7ade9044', 'volume_name': 'volume-bc9b87be-6105-4c40-b0aa-489e7ade9044', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe1e07c-e2ca-42ca-a5ab-a6bd4959529b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe1e07c-e2ca-42ca-a5ab-a6bd4959529b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b6b1cd-da50-456e-8862-7953ffef3c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume bc9b87be-6105-4c40-b0aa-489e7ade9044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc9b87be-6105-4c40-b0aa-489e7ade9044', 'volume_size': 1}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Flow 'volume_create_manager' (2b502b95-7978-4757-afa9-c50a7e68c45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b62be3b-ac59-480c-a634-67a08469e54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b62be3b-ac59-480c-a634-67a08469e54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-300090822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc0f669-ec15-4638-b432-11e2590bdbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9325d1be6774286bffe57ee0e6c52fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:09Z,use_quota=True,user_id='2dfecc29d4c64fb68b038f7cd489bad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5b6ce5-2205-4797-bdf0-e43d933884f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5b6ce5-2205-4797-bdf0-e43d933884f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fcd4c0-1ae5-47b8-9fdb-cf87696d4616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fcd4c0-1ae5-47b8-9fdb-cf87696d4616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc0f669-ec15-4638-b432-11e2590bdbd5', 'volume_name': 'volume-2cc0f669-ec15-4638-b432-11e2590bdbd5', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52c8f26-1331-48e0-8642-ae64eb9e4d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52c8f26-1331-48e0-8642-ae64eb9e4d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76f9025-0d3f-41dd-8ece-5f434fc8cd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume 2cc0f669-ec15-4638-b432-11e2590bdbd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc0f669-ec15-4638-b432-11e2590bdbd5', 'volume_size': 1}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:08 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855 1073741824" returned: 0 in 0.574s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:08 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855
Sep 29 12:43:08 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Flow 'volume_create_manager' (8292c812-62c3-4d96-9436-9fd9cb0f94f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4962f9c9-1183-4461-b013-9e0fa2d2e9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4962f9c9-1183-4461-b013-9e0fa2d2e9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=face89c5-84db-43f6-989f-4726fff3ca42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8d529d190544b9fb3365893992fe5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:09Z,use_quota=True,user_id='9c776ad0932746deaa2ede1d49e4b9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(589191e8-2786-4f9a-98df-b0f37da5f0af),volume_type_id=589191e8-2786-4f9a-98df-b0f37da5f0af)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db516f64-d9f7-4c4b-a9f2-a71bfbf61d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db516f64-d9f7-4c4b-a9f2-a71bfbf61d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799f72a7-82c7-4356-b1f1-899d858e5dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:08 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 12:43:09 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855" returned: 0 in 0.284s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.612s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557249052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c31b00-ea32-4deb-8d7b-2f2e08e0e3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9325d1be6774286bffe57ee0e6c52fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:07Z,use_quota=True,user_id='2dfecc29d4c64fb68b038f7cd489bad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Creating volume 98c31b00-ea32-4deb-8d7b-2f2e08e0e3db {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:09 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fc6760-20ba-45a1-bcd0-aa9b632ee010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c34932e-bec0-4932-9c3c-d080a5e575be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:09 devstack sudo[105697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db 1073741824
Sep 29 12:43:09 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:09 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855 (0dbaf6af-8cca-4a99-8857-3bb03e7e6855): created successfully
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c34932e-bec0-4932-9c3c-d080a5e575be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Flow 'volume_create_manager' (0eb7f9ff-a611-44ab-b87f-e504de113191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5e3e6b52-d840-49ae-9437-0bd4c97e26d9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Created volume successfully.
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799f72a7-82c7-4356-b1f1-899d858e5dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'face89c5-84db-43f6-989f-4726fff3ca42', 'volume_name': 'volume-face89c5-84db-43f6-989f-4726fff3ca42', 'volume_size': 1, 'image_id': '26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc7786d5541497d85ffabda27baa2137', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8d529d190544b9fb3365893992fe5fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '327beec0eef59744b13094ccbda641506e0cb861b206220d0d6658e1a6381d11035211b52362c9f2d5e26d629b8d121a28e6cf8caa3f36efc8b47314fab35e13', 'id': '26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'created_at': datetime.datetime(2026, 9, 29, 10, 43, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 43, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26c2e1e7-48f1-4a20-b517-4df618a0f1e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b7025cb82c0>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdb0936-824e-4279-b15c-2273dfbba5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdb0936-824e-4279-b15c-2273dfbba5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d7234f-679d-4e15-9786-b4b66fda9940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:09 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Volume face89c5-84db-43f6-989f-4726fff3ca42: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-face89c5-84db-43f6-989f-4726fff3ca42', 'volume_size': 1, 'image_id': '26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc7786d5541497d85ffabda27baa2137', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8d529d190544b9fb3365893992fe5fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '327beec0eef59744b13094ccbda641506e0cb861b206220d0d6658e1a6381d11035211b52362c9f2d5e26d629b8d121a28e6cf8caa3f36efc8b47314fab35e13', 'id': '26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'created_at': datetime.datetime(2026, 9, 29, 10, 43, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 43, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26c2e1e7-48f1-4a20-b517-4df618a0f1e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b7025cb82c0>}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Trying to clone face89c5-84db-43f6-989f-4726fff3ca42 from image 26c2e1e7-48f1-4a20-b517-4df618a0f1e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 12:43:09 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Image download 0.00 MB at 0.00 MB/s
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22c8a3b-5f6e-4050-89c7-c5ead40eaf37]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:09 devstack sudo[105702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD
Sep 29 12:43:09 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:09 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db 1073741824" returned: 0 in 0.545s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:09 devstack sudo[105705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db
Sep 29 12:43:09 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:09 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:10 devstack sudo[105709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD
Sep 29 12:43:10 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:10 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db" returned: 0 in 0.303s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.504s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b282a54c-d54f-4d44-ba0d-6111751322d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db6393e-bedc-459e-a00e-b982f6324d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Creating offline snapshot 678e86ea-a144-4b87-93bc-5e8b73c439cb of volume 99cc46d4-d773-46ae-a3ce-49c07f1a6960 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:43:10 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db (98c31b00-ea32-4deb-8d7b-2f2e08e0e3db): created successfully
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db6393e-bedc-459e-a00e-b982f6324d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Flow 'volume_create_manager' (baba1e8a-44c0-4433-bdd1-616062304d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10d257d-474d-4f24-90d6-8296f0270a7e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:10 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7e915716-a0de-4c2c-a54d-535f33cc9462 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Created volume successfully.
Sep 29 12:43:10 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960
Sep 29 12:43:10 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:10 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Temporary image 26c2e1e7-48f1-4a20-b517-4df618a0f1e6 is fetched for user 9c776ad0932746deaa2ede1d49e4b9cf. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ec00a6-7a46-46ae-aa91-9afa4d91bee3]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:10 devstack sudo[105717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD
Sep 29 12:43:10 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:10 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960" returned: 0 in 0.410s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:10 devstack sudo[105722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb 1G
Sep 29 12:43:10 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:10 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:10 devstack sudo[105726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD
Sep 29 12:43:10 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:11 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb 1G" returned: 0 in 0.472s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:11 devstack sudo[105732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb
Sep 29 12:43:11 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:11 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:43:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:11 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb" returned: 0 in 0.285s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:11 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb is being set with open permissions: ugo+rw
Sep 29 12:43:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:11 devstack sudo[105741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb
Sep 29 12:43:11 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:11 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:11 devstack sudo[105744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.info
Sep 29 12:43:11 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:11 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.info" returned: 0 in 0.279s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:11 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.info is being set with open permissions: ugo+rw
Sep 29 12:43:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:11 devstack sudo[105747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.info
Sep 29 12:43:11 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:12 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.info" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.702s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371638584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9b87be-6105-4c40-b0aa-489e7ade9044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9325d1be6774286bffe57ee0e6c52fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:08Z,use_quota=True,user_id='2dfecc29d4c64fb68b038f7cd489bad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Creating volume bc9b87be-6105-4c40-b0aa-489e7ade9044 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:12 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-bc9b87be-6105-4c40-b0aa-489e7ade9044 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:12 devstack sudo[105750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-bc9b87be-6105-4c40-b0aa-489e7ade9044 1073741824
Sep 29 12:43:12 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e1af9c8e-5d5c-4ea5-b753-31f0ac440e46 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Create snapshot completed successfully
Sep 29 12:43:12 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-bc9b87be-6105-4c40-b0aa-489e7ade9044 1073741824" returned: 0 in 0.443s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-bc9b87be-6105-4c40-b0aa-489e7ade9044 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:12 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-bc9b87be-6105-4c40-b0aa-489e7ade9044
Sep 29 12:43:12 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:12 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-bc9b87be-6105-4c40-b0aa-489e7ade9044" returned: 0 in 0.256s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.434s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b6b1cd-da50-456e-8862-7953ffef3c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc9b87be-6105-4c40-b0aa-489e7ade9044', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b358c3-f4b3-45eb-ae18-63482db011ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] Creating offline snapshot e348e73d-c0cb-4096-88b4-25af18906801 of volume 099290bf-efdf-4620-86cb-c4459bb1a840 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:43:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume volume-bc9b87be-6105-4c40-b0aa-489e7ade9044 (bc9b87be-6105-4c40-b0aa-489e7ade9044): created successfully
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b358c3-f4b3-45eb-ae18-63482db011ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Flow 'volume_create_manager' (d99c7407-3c71-47b3-b803-ea079a95e029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f774f59-51f7-4134-9f2f-69603d884bf4]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b5de86ff-80af-4fa8-aa75-7dc593f9eb64 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Created volume successfully.
Sep 29 12:43:13 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840
Sep 29 12:43:13 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Flow 'volume_create_manager' (73cf7e74-4818-46bc-96ee-27b85a78f8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c931bcf3-cdbe-44fc-a51b-fa8f3445c698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:13 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840" returned: 0 in 0.424s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c931bcf3-cdbe-44fc-a51b-fa8f3445c698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1283918284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1573ac74-042f-4973-b113-2ee9d775496f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063b151c3294bbba5f63b879b19bb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:13Z,use_quota=True,user_id='b95cf97506d84e2c910aae03f6d08350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:13 devstack sudo[105765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801 1G
Sep 29 12:43:13 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9beb54bd-a267-4596-9e9b-34f69b299ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9beb54bd-a267-4596-9e9b-34f69b299ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7a837a-fa07-4d6b-9f37-e595f35452a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7a837a-fa07-4d6b-9f37-e595f35452a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1573ac74-042f-4973-b113-2ee9d775496f', 'volume_name': 'volume-1573ac74-042f-4973-b113-2ee9d775496f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e5bc91-a4a1-45e1-acbb-e812ef91990f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e5bc91-a4a1-45e1-acbb-e812ef91990f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bc7fd9-93dc-493d-9d89-b8f084095c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:13 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume 1573ac74-042f-4973-b113-2ee9d775496f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1573ac74-042f-4973-b113-2ee9d775496f', 'volume_size': 1}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Flow 'volume_create_manager' (dd023c85-f0e6-438e-a3ee-1d223c4614a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cddd745-40f0-44c7-b6d2-8532ffdc8252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cddd745-40f0-44c7-b6d2-8532ffdc8252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-844891437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0a50fc-dfa6-4595-981a-6046c32e0909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063b151c3294bbba5f63b879b19bb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:14Z,use_quota=True,user_id='b95cf97506d84e2c910aae03f6d08350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23570a34-229b-4a04-b6a3-875304fb2e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23570a34-229b-4a04-b6a3-875304fb2e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841b9990-0867-4982-a4f8-705aca7fdb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841b9990-0867-4982-a4f8-705aca7fdb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0a50fc-dfa6-4595-981a-6046c32e0909', 'volume_name': 'volume-da0a50fc-dfa6-4595-981a-6046c32e0909', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4375bf12-23ce-466f-b2b5-0155977e5fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4375bf12-23ce-466f-b2b5-0155977e5fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe25fa6-2742-459d-acef-39408094b0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:13 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume da0a50fc-dfa6-4595-981a-6046c32e0909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0a50fc-dfa6-4595-981a-6046c32e0909', 'volume_size': 1}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:13 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801 1G" returned: 0 in 0.535s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-099290bf-efdf-4620-86cb-c4459bb1a840 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:13 devstack sudo[105771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-099290bf-efdf-4620-86cb-c4459bb1a840 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801
Sep 29 12:43:13 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Flow 'volume_create_manager' (d13e3ad8-5d20-4073-98c1-611b65b34b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483d3011-898d-49cc-b2c4-ac5a3a383956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483d3011-898d-49cc-b2c4-ac5a3a383956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934731848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7534ae-960b-4ff8-9c33-74eac6853913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063b151c3294bbba5f63b879b19bb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:14Z,use_quota=True,user_id='b95cf97506d84e2c910aae03f6d08350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f6692b-28cd-4c38-8e55-ac6ca69a32c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f6692b-28cd-4c38-8e55-ac6ca69a32c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4aa09ff-0525-455e-bc87-7746cf61f804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4aa09ff-0525-455e-bc87-7746cf61f804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc7534ae-960b-4ff8-9c33-74eac6853913', 'volume_name': 'volume-fc7534ae-960b-4ff8-9c33-74eac6853913', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:14 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d93249-f458-4b18-a3b3-7919ec628a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d93249-f458-4b18-a3b3-7919ec628a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bfe0ad-00c3-47b1-b277-5c3544daad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume fc7534ae-960b-4ff8-9c33-74eac6853913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc7534ae-960b-4ff8-9c33-74eac6853913', 'volume_size': 1}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-099290bf-efdf-4620-86cb-c4459bb1a840 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801" returned: 0 in 0.389s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:14 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801 is being set with open permissions: ugo+rw
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:14 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801
Sep 29 12:43:14 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:14 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Flow 'volume_create_manager' (71b38b13-f474-45c7-af55-c7b44a5de196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d14157e-7f0a-4244-b3fc-ad406c50a824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801" returned: 0 in 0.331s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d14157e-7f0a-4244-b3fc-ad406c50a824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217381429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7720134d-54a6-4c1f-99fa-53b2fa1f34b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063b151c3294bbba5f63b879b19bb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:15Z,use_quota=True,user_id='b95cf97506d84e2c910aae03f6d08350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb43783-dee0-4d37-881b-195859b4b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb43783-dee0-4d37-881b-195859b4b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978079ad-da2b-4848-aec6-a89479c43262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978079ad-da2b-4848-aec6-a89479c43262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7720134d-54a6-4c1f-99fa-53b2fa1f34b0', 'volume_name': 'volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9cf3d6-cf2e-406b-afc4-b77aa37f747d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9cf3d6-cf2e-406b-afc4-b77aa37f747d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31add833-147d-4c7a-85bf-344bafc2985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:14 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume 7720134d-54a6-4c1f-99fa-53b2fa1f34b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0', 'volume_size': 1}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:14 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.info
Sep 29 12:43:14 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:15 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Flow 'volume_create_manager' (71d5b235-bc13-4d45-961e-540615d9eb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf9cc85-7fa4-4403-a207-23bf7ff36301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.info" returned: 0 in 0.342s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:15 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.info is being set with open permissions: ugo+rw
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf9cc85-7fa4-4403-a207-23bf7ff36301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1981284784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfd01e3-6852-415f-a5a6-2499a79382e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063b151c3294bbba5f63b879b19bb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:15Z,use_quota=True,user_id='b95cf97506d84e2c910aae03f6d08350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:15 devstack sudo[105784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.info
Sep 29 12:43:15 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb83900-3386-43da-9260-d34c4e1a399a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb83900-3386-43da-9260-d34c4e1a399a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731089fe-ba73-4064-9643-1205562e675b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731089fe-ba73-4064-9643-1205562e675b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dfd01e3-6852-415f-a5a6-2499a79382e7', 'volume_name': 'volume-6dfd01e3-6852-415f-a5a6-2499a79382e7', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96df6d96-8525-45c5-a00e-06ca9d92dd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96df6d96-8525-45c5-a00e-06ca9d92dd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3085266b-21cf-4ae6-9018-3835ce4d1b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:15 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume 6dfd01e3-6852-415f-a5a6-2499a79382e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dfd01e3-6852-415f-a5a6-2499a79382e7', 'volume_size': 1}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:15 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.info" returned: 0 in 0.267s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.750s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-300090822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc0f669-ec15-4638-b432-11e2590bdbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9325d1be6774286bffe57ee0e6c52fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:09Z,use_quota=True,user_id='2dfecc29d4c64fb68b038f7cd489bad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Creating volume 2cc0f669-ec15-4638-b432-11e2590bdbd5 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:15 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2cc0f669-ec15-4638-b432-11e2590bdbd5 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:15 devstack sudo[105787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2cc0f669-ec15-4638-b432-11e2590bdbd5 1073741824
Sep 29 12:43:15 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fa606278-4fb2-4bb6-a754-38238e1018ca tempest-ProjectMemberTests-222694199 None] Create snapshot completed successfully
Sep 29 12:43:15 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2cc0f669-ec15-4638-b432-11e2590bdbd5 1073741824" returned: 0 in 0.452s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2cc0f669-ec15-4638-b432-11e2590bdbd5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:15 devstack sudo[105793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2cc0f669-ec15-4638-b432-11e2590bdbd5
Sep 29 12:43:15 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:16 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2cc0f669-ec15-4638-b432-11e2590bdbd5" returned: 0 in 0.300s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.120s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=face89c5-84db-43f6-989f-4726fff3ca42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8d529d190544b9fb3365893992fe5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:09Z,use_quota=True,user_id='9c776ad0932746deaa2ede1d49e4b9cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(589191e8-2786-4f9a-98df-b0f37da5f0af),volume_type_id=589191e8-2786-4f9a-98df-b0f37da5f0af)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Creating volume face89c5-84db-43f6-989f-4726fff3ca42 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:16 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-e348e73d-c0cb-4096-88b4-25af18906801-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76f9025-0d3f-41dd-8ece-5f434fc8cd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc0f669-ec15-4638-b432-11e2590bdbd5', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:16 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42 1073741824
Sep 29 12:43:16 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bd3150-3034-441d-a840-1f1d25af2e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Lock "cinder-e348e73d-c0cb-4096-88b4-25af18906801-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-099290bf-efdf-4620-86cb-c4459bb1a840" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:16 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Volume volume-2cc0f669-ec15-4638-b432-11e2590bdbd5 (2cc0f669-ec15-4638-b432-11e2590bdbd5): created successfully
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bd3150-3034-441d-a840-1f1d25af2e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Flow 'volume_create_manager' (2b502b95-7978-4757-afa9-c50a7e68c45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-25ac32c9-b061-489e-885f-5b29e3c51e2e tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Created volume successfully.
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-099290bf-efdf-4620-86cb-c4459bb1a840" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-e348e73d-c0cb-4096-88b4-25af18906801" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-e348e73d-c0cb-4096-88b4-25af18906801" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Deleting offline snapshot e348e73d-c0cb-4096-88b4-25af18906801 of volume 099290bf-efdf-4620-86cb-c4459bb1a840 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] snapshot_file for this snap is: volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d0fb8c-53f9-4d3f-95b1-6ef268765a61]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:16 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801
Sep 29 12:43:16 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:16 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42 1073741824" returned: 0 in 0.514s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:16 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801" returned: 0 in 0.408s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-099290bf-efdf-4620-86cb-c4459bb1a840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:43:16 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42
Sep 29 12:43:16 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6ea13a-4239-426f-b870-80ca85330001]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:16 devstack sudo[105808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840
Sep 29 12:43:16 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:17 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42" returned: 0 in 0.282s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.615s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1283918284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1573ac74-042f-4973-b113-2ee9d775496f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063b151c3294bbba5f63b879b19bb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:13Z,use_quota=True,user_id='b95cf97506d84e2c910aae03f6d08350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Creating volume 1573ac74-042f-4973-b113-2ee9d775496f {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:17 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-1573ac74-042f-4973-b113-2ee9d775496f 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:17 devstack sudo[105811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-1573ac74-042f-4973-b113-2ee9d775496f 1073741824
Sep 29 12:43:17 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Attempting download of 26c2e1e7-48f1-4a20-b517-4df618a0f1e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'metadata': {}}])) to volume face89c5-84db-43f6-989f-4726fff3ca42. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "cinder-2cc0f669-ec15-4638-b432-11e2590bdbd5-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-2cc0f669-ec15-4638-b432-11e2590bdbd5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e799a84-a6b4-4120-8508-6c2f116c17aa]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "cinder-quobyte-2cc0f669-ec15-4638-b432-11e2590bdbd5" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_la7imde5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-quobyte-2cc0f669-ec15-4638-b432-11e2590bdbd5" acquired by "delete_volume" :: waited 0.044s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c8fef9-4532-4763-9174-dd5f6bf4be58]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2cc0f669-ec15-4638-b432-11e2590bdbd5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:17 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840" returned: 0 in 0.552s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:17 devstack sudo[105815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_la7imde5
Sep 29 12:43:17 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:17 devstack sudo[105821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801
Sep 29 12:43:17 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:17 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2cc0f669-ec15-4638-b432-11e2590bdbd5
Sep 29 12:43:17 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:17 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_la7imde5" returned: 0 in 0.435s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_la7imde5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:17 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-1573ac74-042f-4973-b113-2ee9d775496f 1073741824" returned: 0 in 0.652s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-1573ac74-042f-4973-b113-2ee9d775496f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:17 devstack sudo[105834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-1573ac74-042f-4973-b113-2ee9d775496f
Sep 29 12:43:17 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:17 devstack sudo[105830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_la7imde5
Sep 29 12:43:17 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:17 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2cc0f669-ec15-4638-b432-11e2590bdbd5" returned: 0 in 0.525s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:17 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2cc0f669-ec15-4638-b432-11e2590bdbd5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801" returned: 0 in 0.507s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:17 devstack sudo[105838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2cc0f669-ec15-4638-b432-11e2590bdbd5
Sep 29 12:43:17 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:17 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801
Sep 29 12:43:17 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:18 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-1573ac74-042f-4973-b113-2ee9d775496f" returned: 0 in 0.298s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.228s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-844891437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0a50fc-dfa6-4595-981a-6046c32e0909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063b151c3294bbba5f63b879b19bb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:14Z,use_quota=True,user_id='b95cf97506d84e2c910aae03f6d08350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Creating volume da0a50fc-dfa6-4595-981a-6046c32e0909 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:18 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-da0a50fc-dfa6-4595-981a-6046c32e0909 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:18 devstack sudo[105847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-da0a50fc-dfa6-4595-981a-6046c32e0909 1073741824
Sep 29 12:43:18 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bc7fd9-93dc-493d-9d89-b8f084095c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1573ac74-042f-4973-b113-2ee9d775496f', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70211844-2651-448b-a5be-7e4f4b4f1b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:18 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume volume-1573ac74-042f-4973-b113-2ee9d775496f (1573ac74-042f-4973-b113-2ee9d775496f): created successfully
Sep 29 12:43:18 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70211844-2651-448b-a5be-7e4f4b4f1b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Flow 'volume_create_manager' (73cf7e74-4818-46bc-96ee-27b85a78f8ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_la7imde5" returned: 1 in 0.540s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:18 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_la7imde5' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5ee1ce-d59e-499e-9674-3115302ace32]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840.e348e73d-c0cb-4096-88b4-25af18906801" returned: 0 in 0.341s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-2cc0f669-ec15-4638-b432-11e2590bdbd5" returned: 0 in 0.378s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e570b0fb-4609-4762-a544-c67b768338bb tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created volume successfully.
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-quobyte-2cc0f669-ec15-4638-b432-11e2590bdbd5" released by "delete_volume" :: held 1.005s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-e348e73d-c0cb-4096-88b4-25af18906801" released by "_delete_snapshot" :: held 2.005s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-099290bf-efdf-4620-86cb-c4459bb1a840" released by "delete_snapshot" :: held 2.041s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:18 devstack sudo[105849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD
Sep 29 12:43:18 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Created reservations ['663e80fd-990d-4d02-82d1-0bb74dbb29db', '645baeca-5262-492f-98e7-186afaa0f3c7', '9b5172d7-3cb4-4563-ba8b-d05166303a8a', '17620053-aa8b-4a67-a226-e3a0797b8c64'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Created reservations ['c388b734-c5ec-4fb0-a870-f341267a3056', 'e785fd34-ad5f-4344-8bbb-eeb4305196ac', '61f9830f-0756-4092-a994-3e6efd74dba4', '8451ad73-0549-4d53-8c8a-148d0b00caff'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:18 devstack sudo[105854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:18 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Delete snapshot completed successfully.
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-310f80eb-fea8-414a-94d8-8c46f7e0b4a9 tempest-ProjectMemberTests-222694199 None] Lock "cinder-e348e73d-c0cb-4096-88b4-25af18906801-delete_snapshot" released by "delete_snapshot" :: held 2.331s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:18 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:18 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-da0a50fc-dfa6-4595-981a-6046c32e0909 1073741824" returned: 0 in 0.609s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-da0a50fc-dfa6-4595-981a-6046c32e0909 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:18 devstack sudo[105859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-da0a50fc-dfa6-4595-981a-6046c32e0909
Sep 29 12:43:18 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:18 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.311s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Deleted volume successfully.
Sep 29 12:43:18 devstack sudo[105858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD
Sep 29 12:43:18 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b659df05-15c1-4e32-b128-75e3105915a9 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-2cc0f669-ec15-4638-b432-11e2590bdbd5-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:19 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-da0a50fc-dfa6-4595-981a-6046c32e0909" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.783s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934731848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7534ae-960b-4ff8-9c33-74eac6853913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063b151c3294bbba5f63b879b19bb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:14Z,use_quota=True,user_id='b95cf97506d84e2c910aae03f6d08350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Creating volume fc7534ae-960b-4ff8-9c33-74eac6853913 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:19 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc7534ae-960b-4ff8-9c33-74eac6853913 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe25fa6-2742-459d-acef-39408094b0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0a50fc-dfa6-4595-981a-6046c32e0909', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:19 devstack sudo[105867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc7534ae-960b-4ff8-9c33-74eac6853913 1073741824
Sep 29 12:43:19 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1f6d69-c518-4e2e-88fb-15dd367681ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:19 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD" returned: 1 in 0.441s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] 26c2e1e7-48f1-4a20-b517-4df618a0f1e6 was raw, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume volume-da0a50fc-dfa6-4595-981a-6046c32e0909 (da0a50fc-dfa6-4595-981a-6046c32e0909): created successfully
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1f6d69-c518-4e2e-88fb-15dd367681ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Flow 'volume_create_manager' (dd023c85-f0e6-438e-a3ee-1d223c4614a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:19 devstack sudo[105869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42
Sep 29 12:43:19 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8fb59216-eb9a-4497-a573-b454c9649757 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created volume successfully.
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-099290bf-efdf-4620-86cb-c4459bb1a840-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "cinder-bc9b87be-6105-4c40-b0aa-489e7ade9044-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Lock "cinder-099290bf-efdf-4620-86cb-c4459bb1a840-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-bc9b87be-6105-4c40-b0aa-489e7ade9044-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "cinder-quobyte-bc9b87be-6105-4c40-b0aa-489e7ade9044" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-099290bf-efdf-4620-86cb-c4459bb1a840" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-quobyte-bc9b87be-6105-4c40-b0aa-489e7ade9044" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-099290bf-efdf-4620-86cb-c4459bb1a840" acquired by "delete_volume" :: waited 0.040s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2203ed6-6c01-462e-bf37-ff7ac45f26da]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-bc9b87be-6105-4c40-b0aa-489e7ade9044 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f644c9e-87cb-460d-ab92-06c46e600a4a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:19 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc7534ae-960b-4ff8-9c33-74eac6853913 1073741824" returned: 0 in 0.645s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc7534ae-960b-4ff8-9c33-74eac6853913 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:19 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-bc9b87be-6105-4c40-b0aa-489e7ade9044
Sep 29 12:43:19 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:19 devstack sudo[105881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc7534ae-960b-4ff8-9c33-74eac6853913
Sep 29 12:43:19 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:19 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840
Sep 29 12:43:19 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:19 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42" returned: 0 in 0.756s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26c2e1e7-48f1-4a20-b517-4df618a0f1e6_zvxgz03vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42 {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:43:19 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Converted 0.00 MB image at 0.00 MB/s
Sep 29 12:43:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:19 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42 1G
Sep 29 12:43:19 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:20 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc7534ae-960b-4ff8-9c33-74eac6853913" returned: 0 in 0.314s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:20 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.427s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217381429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7720134d-54a6-4c1f-99fa-53b2fa1f34b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063b151c3294bbba5f63b879b19bb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:15Z,use_quota=True,user_id='b95cf97506d84e2c910aae03f6d08350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Creating volume 7720134d-54a6-4c1f-99fa-53b2fa1f34b0 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:20 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-bc9b87be-6105-4c40-b0aa-489e7ade9044" returned: 0 in 0.484s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-bc9b87be-6105-4c40-b0aa-489e7ade9044 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:20 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0 1073741824
Sep 29 12:43:20 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bfe0ad-00c3-47b1-b277-5c3544daad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7534ae-960b-4ff8-9c33-74eac6853913', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce44588-6656-4713-8611-3e8be68e3922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:20 devstack sudo[105895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-bc9b87be-6105-4c40-b0aa-489e7ade9044
Sep 29 12:43:20 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume volume-fc7534ae-960b-4ff8-9c33-74eac6853913 (fc7534ae-960b-4ff8-9c33-74eac6853913): created successfully
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce44588-6656-4713-8611-3e8be68e3922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:20 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Flow 'volume_create_manager' (d13e3ad8-5d20-4073-98c1-611b65b34b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840" returned: 0 in 0.540s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-42b5e39c-dfee-4101-af58-e9fcfba84d89 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created volume successfully.
Sep 29 12:43:20 devstack sudo[105900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840
Sep 29 12:43:20 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:20 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42 1G" returned: 0 in 0.451s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Downloaded image 26c2e1e7-48f1-4a20-b517-4df618a0f1e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'metadata': {}}])) to volume face89c5-84db-43f6-989f-4726fff3ca42 successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Temporary image 26c2e1e7-48f1-4a20-b517-4df618a0f1e6 for user 9c776ad0932746deaa2ede1d49e4b9cf is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Marking volume face89c5-84db-43f6-989f-4726fff3ca42 as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Copying metadata from image 26c2e1e7-48f1-4a20-b517-4df618a0f1e6 to face89c5-84db-43f6-989f-4726fff3ca42. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Creating volume glance metadata for volume face89c5-84db-43f6-989f-4726fff3ca42 backed by image 26c2e1e7-48f1-4a20-b517-4df618a0f1e6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fc7786d5541497d85ffabda27baa2137', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 12:43:20 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-bc9b87be-6105-4c40-b0aa-489e7ade9044" returned: 0 in 0.356s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-quobyte-bc9b87be-6105-4c40-b0aa-489e7ade9044" released by "delete_volume" :: held 0.923s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:20 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-099290bf-efdf-4620-86cb-c4459bb1a840" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d7234f-679d-4e15-9786-b4b66fda9940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-face89c5-84db-43f6-989f-4726fff3ca42', 'volume_size': 1, 'image_id': '26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc7786d5541497d85ffabda27baa2137', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8d529d190544b9fb3365893992fe5fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '327beec0eef59744b13094ccbda641506e0cb861b206220d0d6658e1a6381d11035211b52362c9f2d5e26d629b8d121a28e6cf8caa3f36efc8b47314fab35e13', 'id': '26c2e1e7-48f1-4a20-b517-4df618a0f1e6', 'created_at': datetime.datetime(2026, 9, 29, 10, 43, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 43, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26c2e1e7-48f1-4a20-b517-4df618a0f1e6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b7025cb82c0>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae745560-44ab-443a-bb71-7267a5d83117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-099290bf-efdf-4620-86cb-c4459bb1a840" released by "delete_volume" :: held 0.968s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:20 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Volume volume-face89c5-84db-43f6-989f-4726fff3ca42 (face89c5-84db-43f6-989f-4726fff3ca42): created successfully
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae745560-44ab-443a-bb71-7267a5d83117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Flow 'volume_create_manager' (8292c812-62c3-4d96-9436-9fd9cb0f94f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5d3698cf-61c1-4bcb-ab8a-51e74fab484c tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Created volume successfully.
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Created reservations ['9fbdbfad-6ef8-4f3b-ab59-80f9d678f689', '0003e029-05b8-4669-afb0-fd9f3df5e673', '5732da52-c75e-4a0f-8305-7d4df406837f', '2951f530-f0d1-4dc9-a9f0-e5adf9be584d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Created reservations ['06d1c07c-6d17-42bc-bccb-cdbf00fcb817', 'd6a7eb7b-a082-41ff-a7aa-1ae3932787a8', '0c691910-2f08-4f8f-84e4-2de93ca3301b', '224c98b6-9b2c-4e12-b97e-09632a483edc'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:20 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0 1073741824" returned: 0 in 0.626s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:20 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:20 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:20 devstack sudo[105911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0
Sep 29 12:43:20 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:20 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:20 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:21 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0" returned: 0 in 0.291s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:21 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.976s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1981284784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfd01e3-6852-415f-a5a6-2499a79382e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063b151c3294bbba5f63b879b19bb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:15Z,use_quota=True,user_id='b95cf97506d84e2c910aae03f6d08350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Creating volume 6dfd01e3-6852-415f-a5a6-2499a79382e7 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:21 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6dfd01e3-6852-415f-a5a6-2499a79382e7 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.344s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Acquiring lock "cinder-face89c5-84db-43f6-989f-4726fff3ca42-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:21 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6dfd01e3-6852-415f-a5a6-2499a79382e7 1073741824
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31add833-147d-4c7a-85bf-344bafc2985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:21 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a96da37-73dd-4ebc-9c66-2c1080d5d370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:21 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Deleted volume successfully.
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.320s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:21 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0 (7720134d-54a6-4c1f-99fa-53b2fa1f34b0): created successfully
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a96da37-73dd-4ebc-9c66-2c1080d5d370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Flow 'volume_create_manager' (71b38b13-f474-45c7-af55-c7b44a5de196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Deleted volume successfully.
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Lock "cinder-face89c5-84db-43f6-989f-4726fff3ca42-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:21 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-301224c5-5e03-42c4-acde-46e64564d30c tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created volume successfully.
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-14ada9f4-cbcb-4c4c-be16-12ee096e0d99 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-bc9b87be-6105-4c40-b0aa-489e7ade9044-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f35ff7c7-5390-4e82-83b5-4991ccca3bf8 tempest-ProjectMemberTests-222694199 None] Lock "cinder-099290bf-efdf-4620-86cb-c4459bb1a840-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Acquiring lock "cinder-quobyte-face89c5-84db-43f6-989f-4726fff3ca42" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Lock "cinder-quobyte-face89c5-84db-43f6-989f-4726fff3ca42" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6ffb78-bb3f-4832-9eec-45c635f9f03d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:21 devstack sudo[105921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42
Sep 29 12:43:21 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:21 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6dfd01e3-6852-415f-a5a6-2499a79382e7 1073741824" returned: 0 in 0.526s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6dfd01e3-6852-415f-a5a6-2499a79382e7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:21 devstack sudo[105929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6dfd01e3-6852-415f-a5a6-2499a79382e7
Sep 29 12:43:21 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:21 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42" returned: 0 in 0.467s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:21 devstack sudo[105932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42
Sep 29 12:43:21 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "cinder-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "cinder-quobyte-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-quobyte-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0e35c5-2de7-445d-80a6-b71fd3baedf7]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:22 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6dfd01e3-6852-415f-a5a6-2499a79382e7" returned: 0 in 0.418s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3085266b-21cf-4ae6-9018-3835ce4d1b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dfd01e3-6852-415f-a5a6-2499a79382e7', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc407b0-21b3-4079-92bd-1a857a0eb5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:22 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Volume volume-6dfd01e3-6852-415f-a5a6-2499a79382e7 (6dfd01e3-6852-415f-a5a6-2499a79382e7): created successfully
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc407b0-21b3-4079-92bd-1a857a0eb5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Flow 'volume_create_manager' (71d5b235-bc13-4d45-961e-540615d9eb8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e43eb785-3f62-4490-8a17-2d91040362e0 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created volume successfully.
Sep 29 12:43:22 devstack sudo[105935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db
Sep 29 12:43:22 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:22 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-face89c5-84db-43f6-989f-4726fff3ca42" returned: 0 in 0.461s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Lock "cinder-quobyte-face89c5-84db-43f6-989f-4726fff3ca42" released by "delete_volume" :: held 0.991s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Created reservations ['ad58965a-20fa-42d0-893e-bb1ee879de26', 'ddd038b6-b6f8-4388-a9b7-718dfcd6016d', '22db623a-8721-4fb4-a4c2-1c54df3bd8e3', '8e151c65-7561-430d-8217-a86f4ab75046'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (6ac2e8d3-1ded-4ec4-8476-5755cbc25656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9640cde-7b04-4d92-8443-2370787448d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9640cde-7b04-4d92-8443-2370787448d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341821481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f7267e-675d-465a-b89f-1d771edc354e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:22Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c8e761-5150-4171-96fb-2918cc34e959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c8e761-5150-4171-96fb-2918cc34e959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9e8d09-d144-4c1b-bf1b-3f594b5ddc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9e8d09-d144-4c1b-bf1b-3f594b5ddc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f7267e-675d-465a-b89f-1d771edc354e', 'volume_name': 'volume-24f7267e-675d-465a-b89f-1d771edc354e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b751206a-b459-42b3-b003-c31be4909584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b751206a-b459-42b3-b003-c31be4909584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd8d2e4-e03d-40db-8b4f-b277a157e2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:22 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Volume 24f7267e-675d-465a-b89f-1d771edc354e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f7267e-675d-465a-b89f-1d771edc354e', 'volume_size': 1}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341821481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f7267e-675d-465a-b89f-1d771edc354e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:22Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Creating volume 24f7267e-675d-465a-b89f-1d771edc354e {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:22 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:22 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:22 devstack sudo[105945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e 1073741824
Sep 29 12:43:22 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db" returned: 0 in 0.614s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:22 devstack sudo[105946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:22 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:22 devstack sudo[105948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db
Sep 29 12:43:22 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:23 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.324s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:23 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Deleted volume successfully.
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-quobyte-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db" released by "delete_volume" :: held 1.006s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-395d54e8-9d0e-47a6-94a5-35b0cf182740 tempest-VolumeAndVolumeTypeFromImageTest-1260697119 None] Lock "cinder-face89c5-84db-43f6-989f-4726fff3ca42-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Created reservations ['f7c44ea2-0da8-4894-99f6-c774aca89a98', 'b5453b40-836c-44b6-9b28-44b2f12d6d77', '2d93d55a-6560-45df-b20b-85cfe12dd91e', '798a8f54-b530-4adf-909a-7bae423316a3'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-6dfd01e3-6852-415f-a5a6-2499a79382e7-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-6dfd01e3-6852-415f-a5a6-2499a79382e7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-quobyte-6dfd01e3-6852-415f-a5a6-2499a79382e7" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-6dfd01e3-6852-415f-a5a6-2499a79382e7" acquired by "delete_volume" :: waited 0.040s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:23 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:23 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfc2f28-d8ac-4ab9-8628-e25c7c636fb8]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6dfd01e3-6852-415f-a5a6-2499a79382e7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:23 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e 1073741824" returned: 0 in 0.760s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:23 devstack sudo[105959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6dfd01e3-6852-415f-a5a6-2499a79382e7
Sep 29 12:43:23 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:23 devstack sudo[105961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e
Sep 29 12:43:23 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:23 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.324s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Deleted volume successfully.
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fb130f28-cede-443c-94c9-b1bc80d7b1fd tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-98c31b00-ea32-4deb-8d7b-2f2e08e0e3db-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:23 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd8d2e4-e03d-40db-8b4f-b277a157e2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f7267e-675d-465a-b89f-1d771edc354e', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4e8dca-e180-4735-b32d-b9a0ca7878ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:23 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6dfd01e3-6852-415f-a5a6-2499a79382e7" returned: 0 in 0.484s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6dfd01e3-6852-415f-a5a6-2499a79382e7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Volume volume-24f7267e-675d-465a-b89f-1d771edc354e (24f7267e-675d-465a-b89f-1d771edc354e): created successfully
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4e8dca-e180-4735-b32d-b9a0ca7878ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:23 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6dfd01e3-6852-415f-a5a6-2499a79382e7
Sep 29 12:43:23 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (6ac2e8d3-1ded-4ec4-8476-5755cbc25656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f894b576-c66c-4c9f-89af-bc77cb285edb tempest-ProjectMemberTests-222694199 None] Created volume successfully.
Sep 29 12:43:24 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-6dfd01e3-6852-415f-a5a6-2499a79382e7" returned: 0 in 0.297s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-6dfd01e3-6852-415f-a5a6-2499a79382e7" released by "delete_volume" :: held 0.829s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created reservations ['b8e05e95-fb20-4f3f-aaa2-d297da521b2c', '3853d146-3b36-4f3f-a406-e0afb401238b', '03cd8752-8bf0-4e78-a2a1-e5e329782547', '81d639b0-5cc7-4194-bd6b-8ed766d98c9a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "cinder-0dbaf6af-8cca-4a99-8857-3bb03e7e6855-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:24 devstack sudo[105971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:24 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-0dbaf6af-8cca-4a99-8857-3bb03e7e6855-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-7720134d-54a6-4c1f-99fa-53b2fa1f34b0-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "cinder-quobyte-0dbaf6af-8cca-4a99-8857-3bb03e7e6855" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-7720134d-54a6-4c1f-99fa-53b2fa1f34b0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-quobyte-0dbaf6af-8cca-4a99-8857-3bb03e7e6855" acquired by "delete_volume" :: waited 0.043s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd09413-a685-486e-a8a8-dfb61134a3fe]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-quobyte-7720134d-54a6-4c1f-99fa-53b2fa1f34b0" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-7720134d-54a6-4c1f-99fa-53b2fa1f34b0" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:24 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.360s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Deleted volume successfully.
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6c6d4b-6d63-45cb-9630-c06c4105e3e7]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-6ecd53c4-5daf-4dd6-8876-3e0c0b57cb7b tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-6dfd01e3-6852-415f-a5a6-2499a79382e7-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:24 devstack sudo[105973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855
Sep 29 12:43:24 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] Creating offline snapshot 5c0b704e-b3e3-480b-8b19-737b4e3e7260 of volume 24f7267e-675d-465a-b89f-1d771edc354e {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:43:24 devstack sudo[105976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0
Sep 29 12:43:24 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e34357-aa93-4b69-b0d6-9b55997bb84a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:25 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e
Sep 29 12:43:25 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:25 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855" returned: 0 in 0.558s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:25 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855
Sep 29 12:43:25 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:25 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0" returned: 0 in 0.596s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:25 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0
Sep 29 12:43:25 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:25 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e" returned: 0 in 0.509s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:25 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0dbaf6af-8cca-4a99-8857-3bb03e7e6855" returned: 0 in 0.328s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:25 devstack sudo[105996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260 1G
Sep 29 12:43:25 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-quobyte-0dbaf6af-8cca-4a99-8857-3bb03e7e6855" released by "delete_volume" :: held 0.993s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Created reservations ['37858cec-c6ed-4eee-a9d3-4c4eb2709f3a', '38a9983d-5c01-498c-ba14-c38084b60eec', '54934f70-ac66-4b0e-8961-6141736a033e', '5945f2fe-742f-45f9-a91f-f422ddffa6b4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:25 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7720134d-54a6-4c1f-99fa-53b2fa1f34b0" returned: 0 in 0.345s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-7720134d-54a6-4c1f-99fa-53b2fa1f34b0" released by "delete_volume" :: held 1.028s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:25 devstack sudo[105999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:25 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created reservations ['bd02a330-a759-47a3-9d29-5755ea6ca419', 'de008ad3-a056-47fb-a616-8cbbf61f3c5a', 'facd7ec7-a4bf-4622-a18d-a9805a8e4175', 'f4eb1fd3-08a6-4cc7-96cc-6a980c82dc4e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:25 devstack sudo[106004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:25 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:26 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260 1G" returned: 0 in 0.665s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24f7267e-675d-465a-b89f-1d771edc354e -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:26 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.431s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Deleted volume successfully.
Sep 29 12:43:26 devstack sudo[106008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24f7267e-675d-465a-b89f-1d771edc354e -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260
Sep 29 12:43:26 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bec4cab4-4819-45d2-b1f9-6a9df874ba85 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-0dbaf6af-8cca-4a99-8857-3bb03e7e6855-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:26 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.325s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Deleted volume successfully.
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c5b58cf1-4b26-4a86-a892-af39c29f3db2 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-7720134d-54a6-4c1f-99fa-53b2fa1f34b0-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:26 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24f7267e-675d-465a-b89f-1d771edc354e -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260" returned: 0 in 0.351s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:26 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260 is being set with open permissions: ugo+rw
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:26 devstack sudo[106015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260
Sep 29 12:43:26 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "cinder-545b56c4-e65c-448b-b400-db8a9858a13b-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-545b56c4-e65c-448b-b400-db8a9858a13b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "cinder-quobyte-545b56c4-e65c-448b-b400-db8a9858a13b" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-quobyte-545b56c4-e65c-448b-b400-db8a9858a13b" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:26 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fca802-6e26-46a1-91d1-fcaf3bdd1544]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-545b56c4-e65c-448b-b400-db8a9858a13b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-fc7534ae-960b-4ff8-9c33-74eac6853913-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-fc7534ae-960b-4ff8-9c33-74eac6853913-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:26 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.info
Sep 29 12:43:26 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:27 devstack sudo[106018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-545b56c4-e65c-448b-b400-db8a9858a13b
Sep 29 12:43:27 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-quobyte-fc7534ae-960b-4ff8-9c33-74eac6853913" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-fc7534ae-960b-4ff8-9c33-74eac6853913" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[42916ac6-facd-4b13-a49d-2d6aaf38cc96]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc7534ae-960b-4ff8-9c33-74eac6853913 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:27 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.info" returned: 0 in 0.383s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:27 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.info is being set with open permissions: ugo+rw
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:27 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc7534ae-960b-4ff8-9c33-74eac6853913
Sep 29 12:43:27 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:27 devstack sudo[106028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.info
Sep 29 12:43:27 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:27 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-545b56c4-e65c-448b-b400-db8a9858a13b" returned: 0 in 0.554s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-545b56c4-e65c-448b-b400-db8a9858a13b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:27 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-545b56c4-e65c-448b-b400-db8a9858a13b
Sep 29 12:43:27 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:27 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.info" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:27 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.707s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc7534ae-960b-4ff8-9c33-74eac6853913" returned: 0 in 0.522s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc7534ae-960b-4ff8-9c33-74eac6853913 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:27 devstack sudo[106036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc7534ae-960b-4ff8-9c33-74eac6853913
Sep 29 12:43:27 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:27 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-663621bc-43d4-4c53-ba82-48d4ad995ae6 tempest-ProjectMemberTests-222694199 None] Create snapshot completed successfully
Sep 29 12:43:27 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-545b56c4-e65c-448b-b400-db8a9858a13b" returned: 0 in 0.333s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-quobyte-545b56c4-e65c-448b-b400-db8a9858a13b" released by "delete_volume" :: held 0.946s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Created reservations ['37f2a177-1de0-4a17-92ee-566c328403d4', '6799f143-13c1-4b91-87e3-4ac30784bdff', '0e4fe2e6-0af2-4dd8-ab0d-af037c58f1f4', 'a4b9b2a5-8f8d-4e6a-b795-33fbbad95473'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:27 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc7534ae-960b-4ff8-9c33-74eac6853913" returned: 0 in 0.333s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:27 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:27 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-fc7534ae-960b-4ff8-9c33-74eac6853913" released by "delete_volume" :: held 0.927s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created reservations ['b7508554-255e-4b23-8c7f-fc39360479cd', '58dce811-3e3e-42d5-b177-0d091fd875e2', 'a12b7217-620c-4890-a381-e2a0f51870c1', '6b322bbb-8ba3-4e8c-9584-378d9c0fcb6f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-5c0b704e-b3e3-480b-8b19-737b4e3e7260-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:28 devstack sudo[106042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:28 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Lock "cinder-5c0b704e-b3e3-480b-8b19-737b4e3e7260-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-24f7267e-675d-465a-b89f-1d771edc354e" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-24f7267e-675d-465a-b89f-1d771edc354e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-5c0b704e-b3e3-480b-8b19-737b4e3e7260" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-5c0b704e-b3e3-480b-8b19-737b4e3e7260" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Deleting offline snapshot 5c0b704e-b3e3-480b-8b19-737b4e3e7260 of volume 24f7267e-675d-465a-b89f-1d771edc354e {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:43:28 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] snapshot_file for this snap is: volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.363s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Deleted volume successfully.
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9831e2e1-2298-4363-9b2e-413a9ab318d5]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-4faa0554-3186-4dce-8ae6-2884f0cced2f tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-545b56c4-e65c-448b-b400-db8a9858a13b-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:28 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:28 devstack sudo[106045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260
Sep 29 12:43:28 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.302s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Deleted volume successfully.
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ccbe61b7-4522-4bdb-aab8-00f9ef308e79 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-fc7534ae-960b-4ff8-9c33-74eac6853913-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:28 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24f7267e-675d-465a-b89f-1d771edc354e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e842f4a-19fa-43f9-a2f4-927d7c87b0b0]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:28 devstack sudo[106051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e
Sep 29 12:43:28 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "cinder-14550216-0167-4dc1-8fcd-ae2d94f15dea-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-14550216-0167-4dc1-8fcd-ae2d94f15dea-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "cinder-quobyte-14550216-0167-4dc1-8fcd-ae2d94f15dea" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-quobyte-14550216-0167-4dc1-8fcd-ae2d94f15dea" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7b540e-d1f9-443e-b89d-2c7e0d95adae]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14550216-0167-4dc1-8fcd-ae2d94f15dea {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-da0a50fc-dfa6-4595-981a-6046c32e0909-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-da0a50fc-dfa6-4595-981a-6046c32e0909-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:29 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e" returned: 0 in 0.474s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:29 devstack sudo[106055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14550216-0167-4dc1-8fcd-ae2d94f15dea
Sep 29 12:43:29 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-quobyte-da0a50fc-dfa6-4595-981a-6046c32e0909" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:29 devstack sudo[106058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260
Sep 29 12:43:29 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-da0a50fc-dfa6-4595-981a-6046c32e0909" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f83e65-d47d-4cc0-b4d2-1b681abd4454]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-da0a50fc-dfa6-4595-981a-6046c32e0909 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:29 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-da0a50fc-dfa6-4595-981a-6046c32e0909
Sep 29 12:43:29 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:29 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14550216-0167-4dc1-8fcd-ae2d94f15dea" returned: 0 in 0.506s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14550216-0167-4dc1-8fcd-ae2d94f15dea {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:29 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14550216-0167-4dc1-8fcd-ae2d94f15dea
Sep 29 12:43:29 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:29 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260" returned: 0 in 0.499s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:29 devstack sudo[106074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260
Sep 29 12:43:29 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Flow 'volume_create_manager' (7fbc3738-3da6-4721-bd30-e0090a9888a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5016c90-6525-4a3e-afbe-c939264d109a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:29 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-da0a50fc-dfa6-4595-981a-6046c32e0909" returned: 0 in 0.568s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-da0a50fc-dfa6-4595-981a-6046c32e0909 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:29 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-da0a50fc-dfa6-4595-981a-6046c32e0909
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5016c90-6525-4a3e-afbe-c939264d109a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-309355309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce37b86a-3af3-4ae8-8789-fc5a63e0eea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953627c4cb604cb181c888ae72e6d1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:30Z,use_quota=True,user_id='9381b116ea3a407c83276621bb559dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:30 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f43eaf-1853-461b-9342-7d859f0c2f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f43eaf-1853-461b-9342-7d859f0c2f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a000c9-c1d6-46d1-897e-904ee1480f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a000c9-c1d6-46d1-897e-904ee1480f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce37b86a-3af3-4ae8-8789-fc5a63e0eea5', 'volume_name': 'volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ebc995-76d7-452b-9a73-7f2f38ab73c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ebc995-76d7-452b-9a73-7f2f38ab73c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e5df30-635d-464e-b8c5-4bf8a57b3726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:30 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Volume ce37b86a-3af3-4ae8-8789-fc5a63e0eea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5', 'volume_size': 1}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-309355309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce37b86a-3af3-4ae8-8789-fc5a63e0eea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953627c4cb604cb181c888ae72e6d1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:30Z,use_quota=True,user_id='9381b116ea3a407c83276621bb559dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Creating volume ce37b86a-3af3-4ae8-8789-fc5a63e0eea5 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:30 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:30 devstack sudo[106080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5 1073741824
Sep 29 12:43:30 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:30 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-14550216-0167-4dc1-8fcd-ae2d94f15dea" returned: 0 in 0.446s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-quobyte-14550216-0167-4dc1-8fcd-ae2d94f15dea" released by "delete_volume" :: held 1.043s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:30 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e.5c0b704e-b3e3-480b-8b19-737b4e3e7260" returned: 0 in 0.465s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Created reservations ['21cea000-9722-418b-8a17-d83e714d37dd', '469be6e2-b27b-4119-bb32-3fc2c5921db3', 'a12ad7c4-2334-4134-956d-b738fda4f112', 'a7050d2c-7930-4c7a-ad23-d3152700d5d8'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-5c0b704e-b3e3-480b-8b19-737b4e3e7260" released by "_delete_snapshot" :: held 2.048s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:30 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-24f7267e-675d-465a-b89f-1d771edc354e" released by "delete_snapshot" :: held 2.088s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-da0a50fc-dfa6-4595-981a-6046c32e0909" returned: 0 in 0.431s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-da0a50fc-dfa6-4595-981a-6046c32e0909" released by "delete_volume" :: held 1.080s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:30 devstack sudo[106087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:30 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Flow 'volume_create_manager' (2790f886-ef2e-42be-8c3f-713e373bd982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81efa35-ca4c-472c-8d5c-bbf6681acb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81efa35-ca4c-472c-8d5c-bbf6681acb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-463025802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d909e5a8-c466-4828-9b2d-c87c34c31688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953627c4cb604cb181c888ae72e6d1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:30Z,use_quota=True,user_id='9381b116ea3a407c83276621bb559dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc812cca-216f-42ae-923c-528c7f16cc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc812cca-216f-42ae-923c-528c7f16cc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e65e16-61c4-40f2-8ce0-251e130bd4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e65e16-61c4-40f2-8ce0-251e130bd4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd909e5a8-c466-4828-9b2d-c87c34c31688', 'volume_name': 'volume-d909e5a8-c466-4828-9b2d-c87c34c31688', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cde544-51a4-4204-9450-09573b921a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cde544-51a4-4204-9450-09573b921a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7914c885-692f-4fd9-bea9-0e45b726d4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:30 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Volume d909e5a8-c466-4828-9b2d-c87c34c31688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d909e5a8-c466-4828-9b2d-c87c34c31688', 'volume_size': 1}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Created reservations ['66901282-60af-47cb-a628-857912c41b98', '03ed2a1b-5aa4-43b7-866e-3fa443424070', '1766d96c-dbe1-4ccd-b9eb-89dacb02dc82', '102d976c-edce-448f-b956-d25b4570d4e7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created reservations ['ee7751fa-ca0e-4bf1-ab8c-eb60e762f41e', '748bfcc1-87de-4fd4-a0e0-92942f692c6b', '6dfe60a7-18f7-44f9-a3dc-22fad3b28200', '58f15d4a-0f3f-4d2c-99b3-bf7ed72933e8'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:30 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5 1073741824" returned: 0 in 0.741s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:30 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Delete snapshot completed successfully.
Sep 29 12:43:30 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.357s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:30 devstack sudo[106091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5e979c1c-6772-4204-9ff5-deea9be7bda7 tempest-ProjectMemberTests-222694199 None] Lock "cinder-5c0b704e-b3e3-480b-8b19-737b4e3e7260-delete_snapshot" released by "delete_snapshot" :: held 2.709s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:30 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:30 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Deleted volume successfully.
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:31 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:31 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Flow 'volume_create_manager' (c57411f8-88e7-41e2-82ac-e72d918dd353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1899543-c6ce-4588-9319-14971dd474d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3dbdce67-cefa-419e-a8e7-88242fea1449 tempest-CreateVolumesFromSourceVolumeTest-1880545341 None] Lock "cinder-14550216-0167-4dc1-8fcd-ae2d94f15dea-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1899543-c6ce-4588-9319-14971dd474d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1122312564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19bdf0d-db6b-47a9-a984-0354f0cf0eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953627c4cb604cb181c888ae72e6d1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:31Z,use_quota=True,user_id='9381b116ea3a407c83276621bb559dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626b0744-6628-4177-91f8-71d9c4ec2d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626b0744-6628-4177-91f8-71d9c4ec2d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2c3828-3995-4e2e-9821-133b9ba7af99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2c3828-3995-4e2e-9821-133b9ba7af99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f19bdf0d-db6b-47a9-a984-0354f0cf0eb1', 'volume_name': 'volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b0df4d-8c71-4532-a91a-a158bebb2ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b0df4d-8c71-4532-a91a-a158bebb2ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b837ca-207b-4042-9502-0ec85433ad05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:31 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Volume f19bdf0d-db6b-47a9-a984-0354f0cf0eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1', 'volume_size': 1}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:31 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5" returned: 0 in 0.313s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-463025802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d909e5a8-c466-4828-9b2d-c87c34c31688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953627c4cb604cb181c888ae72e6d1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:30Z,use_quota=True,user_id='9381b116ea3a407c83276621bb559dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Creating volume d909e5a8-c466-4828-9b2d-c87c34c31688 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:31 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d909e5a8-c466-4828-9b2d-c87c34c31688 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e5df30-635d-464e-b8c5-4bf8a57b3726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:31 devstack sudo[106096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d909e5a8-c466-4828-9b2d-c87c34c31688 1073741824
Sep 29 12:43:31 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cf9858-1465-44a0-8e8c-b5e61b96a130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:31 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Volume volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5 (ce37b86a-3af3-4ae8-8789-fc5a63e0eea5): created successfully
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cf9858-1465-44a0-8e8c-b5e61b96a130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:31 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Flow 'volume_create_manager' (7fbc3738-3da6-4721-bd30-e0090a9888a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.381s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Deleted volume successfully.
Sep 29 12:43:31 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d30ff839-aaee-4847-8691-37d8668dac2a tempest-CreateVolumesFromImageTest-1442870843 None] Created volume successfully.
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dab1b825-e1ff-42d9-80f9-af60f35b9e49 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-da0a50fc-dfa6-4595-981a-6046c32e0909-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Flow 'volume_create_manager' (3c18ece8-5903-424e-af2f-428ed4210077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a03bebd-6f90-40aa-99a3-f279bb332ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a03bebd-6f90-40aa-99a3-f279bb332ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1242213525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953627c4cb604cb181c888ae72e6d1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:31Z,use_quota=True,user_id='9381b116ea3a407c83276621bb559dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40c039c-0dde-4024-9a0c-5aef9a11c38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40c039c-0dde-4024-9a0c-5aef9a11c38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5c38a7-7d68-470b-ae3e-fef20aa753f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5c38a7-7d68-470b-ae3e-fef20aa753f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c', 'volume_name': 'volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f765aee-43a3-4e25-bad3-5ef62741ac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f765aee-43a3-4e25-bad3-5ef62741ac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b2e4d2-f276-48b5-abea-23bb59666dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:31 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Volume 7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c', 'volume_size': 1}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-24f7267e-675d-465a-b89f-1d771edc354e-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Lock "cinder-24f7267e-675d-465a-b89f-1d771edc354e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-1573ac74-042f-4973-b113-2ee9d775496f-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-24f7267e-675d-465a-b89f-1d771edc354e" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-1573ac74-042f-4973-b113-2ee9d775496f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-24f7267e-675d-465a-b89f-1d771edc354e" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9890742c-5da5-4f26-859b-f22ab9c664ef]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:31 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-quobyte-1573ac74-042f-4973-b113-2ee9d775496f" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-1573ac74-042f-4973-b113-2ee9d775496f" acquired by "delete_volume" :: waited 0.042s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce7e105-2fe5-403b-a200-5741d3e28b97]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-1573ac74-042f-4973-b113-2ee9d775496f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:32 devstack sudo[106102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e
Sep 29 12:43:32 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:32 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d909e5a8-c466-4828-9b2d-c87c34c31688 1073741824" returned: 0 in 0.851s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d909e5a8-c466-4828-9b2d-c87c34c31688 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:32 devstack sudo[106103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-1573ac74-042f-4973-b113-2ee9d775496f
Sep 29 12:43:32 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:32 devstack sudo[106105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d909e5a8-c466-4828-9b2d-c87c34c31688
Sep 29 12:43:32 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Flow 'volume_create_manager' (61269efb-959b-495d-9ec1-a8d307e8592d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c59aa07-9913-4a94-ac0c-f16b0e88da38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c59aa07-9913-4a94-ac0c-f16b0e88da38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1627901815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79dfd520-e3d3-4185-ae66-020b84cabd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953627c4cb604cb181c888ae72e6d1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:32Z,use_quota=True,user_id='9381b116ea3a407c83276621bb559dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d6574f-998f-44bb-9943-e35fa13065d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d6574f-998f-44bb-9943-e35fa13065d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6caf09d5-d5ef-445b-a56b-352ebaa94630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6caf09d5-d5ef-445b-a56b-352ebaa94630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79dfd520-e3d3-4185-ae66-020b84cabd60', 'volume_name': 'volume-79dfd520-e3d3-4185-ae66-020b84cabd60', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa034cad-3c07-4651-9159-696a69739091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa034cad-3c07-4651-9159-696a69739091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671a5175-1209-478b-b024-f6ff46d5fdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:32 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Volume 79dfd520-e3d3-4185-ae66-020b84cabd60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79dfd520-e3d3-4185-ae66-020b84cabd60', 'volume_size': 1}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:32 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e" returned: 0 in 0.598s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:32 devstack sudo[106116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e
Sep 29 12:43:32 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:32 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:32 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-1573ac74-042f-4973-b113-2ee9d775496f" returned: 0 in 0.494s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-1573ac74-042f-4973-b113-2ee9d775496f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d909e5a8-c466-4828-9b2d-c87c34c31688" returned: 0 in 0.371s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1122312564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19bdf0d-db6b-47a9-a984-0354f0cf0eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953627c4cb604cb181c888ae72e6d1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:31Z,use_quota=True,user_id='9381b116ea3a407c83276621bb559dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Creating volume f19bdf0d-db6b-47a9-a984-0354f0cf0eb1 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:32 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:32 devstack sudo[106118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-1573ac74-042f-4973-b113-2ee9d775496f
Sep 29 12:43:32 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:32 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1 1073741824
Sep 29 12:43:32 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7914c885-692f-4fd9-bea9-0e45b726d4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d909e5a8-c466-4828-9b2d-c87c34c31688', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7ec07e-73f5-45b2-9ba0-e9561c09bb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:32 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Volume volume-d909e5a8-c466-4828-9b2d-c87c34c31688 (d909e5a8-c466-4828-9b2d-c87c34c31688): created successfully
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7ec07e-73f5-45b2-9ba0-e9561c09bb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Flow 'volume_create_manager' (2790f886-ef2e-42be-8c3f-713e373bd982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-962de607-2d9a-4207-a44f-4f91068f5a40 tempest-CreateVolumesFromImageTest-1442870843 None] Created volume successfully.
Sep 29 12:43:32 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-24f7267e-675d-465a-b89f-1d771edc354e" returned: 0 in 0.329s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-24f7267e-675d-465a-b89f-1d771edc354e" released by "delete_volume" :: held 1.048s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Created reservations ['30ff3a69-74a7-41b8-b611-be7df73c8fca', 'b06625bc-1090-41c6-a0d0-beea88ca7bb1', '816c0dd5-315b-4084-879d-ed4b97abdb9a', 'c9b8c1d1-f8bb-49f6-b00b-bac225667a1c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:33 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-1573ac74-042f-4973-b113-2ee9d775496f" returned: 0 in 0.460s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-1573ac74-042f-4973-b113-2ee9d775496f" released by "delete_volume" :: held 1.017s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created reservations ['14b96e5c-fc9c-420e-b986-6eb8abe256c6', 'c2c55ba9-f9b4-46b4-97e8-d186b0f67183', '889dd490-c3b9-4ce5-9cd1-5be1fdfecf6a', 'ce4e2c60-3064-40a6-b507-5e1cb6abe7aa'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:33 devstack sudo[106127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:33 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:33 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1 1073741824" returned: 0 in 0.754s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:33 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:33 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:33 devstack sudo[106133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1
Sep 29 12:43:33 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:33 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.346s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Deleted volume successfully.
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ac435974-24a2-4089-aa0b-55eb7e900dd8 tempest-ProjectMemberTests-222694199 None] Lock "cinder-24f7267e-675d-465a-b89f-1d771edc354e-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:33 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.358s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Deleted volume successfully.
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-88de029b-10fc-4a72-a14d-0695a7fb4edf tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-1573ac74-042f-4973-b113-2ee9d775496f-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:33 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1" returned: 0 in 0.305s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.062s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1242213525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953627c4cb604cb181c888ae72e6d1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:31Z,use_quota=True,user_id='9381b116ea3a407c83276621bb559dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Creating volume 7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:33 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:33 devstack sudo[106138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c 1073741824
Sep 29 12:43:33 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b837ca-207b-4042-9502-0ec85433ad05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d53fe2-cf8a-493d-814b-50ecf0f724d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:33 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Volume volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1 (f19bdf0d-db6b-47a9-a984-0354f0cf0eb1): created successfully
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d53fe2-cf8a-493d-814b-50ecf0f724d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:33 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Flow 'volume_create_manager' (c57411f8-88e7-41e2-82ac-e72d918dd353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:33 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-156d8a45-f5a0-448f-9eda-ed7e8628518c tempest-CreateVolumesFromImageTest-1442870843 None] Created volume successfully.
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-678e86ea-a144-4b87-93bc-5e8b73c439cb-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-678e86ea-a144-4b87-93bc-5e8b73c439cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-quobyte-99cc46d4-d773-46ae-a3ce-49c07f1a6960" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-99cc46d4-d773-46ae-a3ce-49c07f1a6960" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-quobyte-678e86ea-a144-4b87-93bc-5e8b73c439cb" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-678e86ea-a144-4b87-93bc-5e8b73c439cb" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Deleting offline snapshot 678e86ea-a144-4b87-93bc-5e8b73c439cb of volume 99cc46d4-d773-46ae-a3ce-49c07f1a6960 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] snapshot_file for this snap is: volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[85902b50-9740-46e9-8b96-4fa765b181fc]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:34 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c 1073741824" returned: 0 in 0.656s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:34 devstack sudo[106144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb
Sep 29 12:43:34 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:34 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c
Sep 29 12:43:34 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (31614c11-2089-48b7-ad0d-0618fa247942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ac2943-9179-45d3-a933-c585531d451e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ac2943-9179-45d3-a933-c585531d451e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567916890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b911d2-3c16-4ed0-a54b-b6e354467981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:34Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974dc790-64d9-4d80-a18f-31aea9d6b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974dc790-64d9-4d80-a18f-31aea9d6b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3c4692-b79a-4447-9334-f2b30fcd47cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3c4692-b79a-4447-9334-f2b30fcd47cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b911d2-3c16-4ed0-a54b-b6e354467981', 'volume_name': 'volume-31b911d2-3c16-4ed0-a54b-b6e354467981', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cf5de9-77c1-4b75-9108-2678ad474a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cf5de9-77c1-4b75-9108-2678ad474a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecaa296b-2d4f-42e9-b3bd-48b6817e388c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:34 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Volume 31b911d2-3c16-4ed0-a54b-b6e354467981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b911d2-3c16-4ed0-a54b-b6e354467981', 'volume_size': 1}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:34 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:34 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb" returned: 0 in 0.543s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c" returned: 0 in 0.312s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.399s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1627901815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79dfd520-e3d3-4185-ae66-020b84cabd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953627c4cb604cb181c888ae72e6d1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:32Z,use_quota=True,user_id='9381b116ea3a407c83276621bb559dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Creating volume 79dfd520-e3d3-4185-ae66-020b84cabd60 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:34 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-79dfd520-e3d3-4185-ae66-020b84cabd60 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bece6e-b316-4f0e-99fe-ff7fa6af4125]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:34 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-79dfd520-e3d3-4185-ae66-020b84cabd60 1073741824
Sep 29 12:43:34 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b2e4d2-f276-48b5-abea-23bb59666dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eea6b14-7f6f-4069-8587-ff2590b6a783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:34 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Volume volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c (7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c): created successfully
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eea6b14-7f6f-4069-8587-ff2590b6a783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:34 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Flow 'volume_create_manager' (3c18ece8-5903-424e-af2f-428ed4210077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a3b57220-ef41-457e-af1a-cf41e78943e6 tempest-CreateVolumesFromImageTest-1442870843 None] Created volume successfully.
Sep 29 12:43:34 devstack sudo[106155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960
Sep 29 12:43:34 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:35 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960" returned: 0 in 0.457s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:35 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb
Sep 29 12:43:35 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:35 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-79dfd520-e3d3-4185-ae66-020b84cabd60 1073741824" returned: 0 in 0.582s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-79dfd520-e3d3-4185-ae66-020b84cabd60 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:35 devstack sudo[106167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-79dfd520-e3d3-4185-ae66-020b84cabd60
Sep 29 12:43:35 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Flow 'volume_create_manager' (dde70922-760b-49da-a7e6-8f0b293d87c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da03ed3e-3124-4a49-a606-309525964906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da03ed3e-3124-4a49-a606-309525964906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-80189670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d020fa1-c0da-4274-9cad-1bd1377616f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b1b4bd6b6345398cdb8ddae5d8cf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:35Z,use_quota=True,user_id='28f3ac4b71a246c398ad1c91a82427a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f1a157-38a8-44c2-8135-6891ccced145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f1a157-38a8-44c2-8135-6891ccced145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060ddeee-9865-43f0-a9c7-3f6d306f5b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060ddeee-9865-43f0-a9c7-3f6d306f5b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d020fa1-c0da-4274-9cad-1bd1377616f4', 'volume_name': 'volume-4d020fa1-c0da-4274-9cad-1bd1377616f4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6218a216-12b1-4cfd-87af-f17cb72fabee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6218a216-12b1-4cfd-87af-f17cb72fabee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a310c2a-7320-41cf-b786-b220d848f8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:35 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Volume 4d020fa1-c0da-4274-9cad-1bd1377616f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d020fa1-c0da-4274-9cad-1bd1377616f4', 'volume_size': 1}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:35 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb" returned: 0 in 0.390s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:35 devstack sudo[106173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb
Sep 29 12:43:35 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:35 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-79dfd520-e3d3-4185-ae66-020b84cabd60" returned: 0 in 0.306s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.048s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567916890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b911d2-3c16-4ed0-a54b-b6e354467981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:34Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Creating volume 31b911d2-3c16-4ed0-a54b-b6e354467981 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:35 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671a5175-1209-478b-b024-f6ff46d5fdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79dfd520-e3d3-4185-ae66-020b84cabd60', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f996019-7b9e-438a-a006-2b2d1e1d52b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:35 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981 1073741824
Sep 29 12:43:35 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:35 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Volume volume-79dfd520-e3d3-4185-ae66-020b84cabd60 (79dfd520-e3d3-4185-ae66-020b84cabd60): created successfully
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f996019-7b9e-438a-a006-2b2d1e1d52b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Flow 'volume_create_manager' (61269efb-959b-495d-9ec1-a8d307e8592d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f50864a9-7774-43e2-a052-d4575b0ae80b tempest-CreateVolumesFromImageTest-1442870843 None] Created volume successfully.
Sep 29 12:43:35 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960.678e86ea-a144-4b87-93bc-5e8b73c439cb" returned: 0 in 0.269s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-678e86ea-a144-4b87-93bc-5e8b73c439cb" released by "_delete_snapshot" :: held 1.815s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-99cc46d4-d773-46ae-a3ce-49c07f1a6960" released by "delete_snapshot" :: held 1.851s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created reservations ['cb80197b-3868-4266-b80e-a52bd759d86f', '6f9257a1-bd92-438c-b2d6-ab75c9f60d53', 'df019ed6-f63c-4559-a096-62d34e8b5c29', '6a37f160-2c39-4c82-a2e4-191a2785c8b8'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Delete snapshot completed successfully.
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-dad29f53-22bb-4ac4-adaf-f16d2625edf9 tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-678e86ea-a144-4b87-93bc-5e8b73c439cb-delete_snapshot" released by "delete_snapshot" :: held 1.988s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:36 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981 1073741824" returned: 0 in 0.458s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:36 devstack sudo[106183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981
Sep 29 12:43:36 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-99cc46d4-d773-46ae-a3ce-49c07f1a6960-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-99cc46d4-d773-46ae-a3ce-49c07f1a6960-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "cinder-quobyte-99cc46d4-d773-46ae-a3ce-49c07f1a6960" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-99cc46d4-d773-46ae-a3ce-49c07f1a6960" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0fd438-6c18-455e-9fcd-48d36d45240b]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:36 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960
Sep 29 12:43:36 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:36 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981" returned: 0 in 0.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.958s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-80189670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d020fa1-c0da-4274-9cad-1bd1377616f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b1b4bd6b6345398cdb8ddae5d8cf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:35Z,use_quota=True,user_id='28f3ac4b71a246c398ad1c91a82427a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Creating volume 4d020fa1-c0da-4274-9cad-1bd1377616f4 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:36 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecaa296b-2d4f-42e9-b3bd-48b6817e388c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b911d2-3c16-4ed0-a54b-b6e354467981', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:36 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 1073741824
Sep 29 12:43:36 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed1387d-f4ff-443b-8ac9-612cf0d6e91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Volume volume-31b911d2-3c16-4ed0-a54b-b6e354467981 (31b911d2-3c16-4ed0-a54b-b6e354467981): created successfully
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed1387d-f4ff-443b-8ac9-612cf0d6e91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (31614c11-2089-48b7-ad0d-0618fa247942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-990393ab-131c-459e-94de-850bac6e4181 tempest-ProjectMemberTests-222694199 None] Created volume successfully.
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "cinder-79dfd520-e3d3-4185-ae66-020b84cabd60-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-79dfd520-e3d3-4185-ae66-020b84cabd60-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "cinder-quobyte-79dfd520-e3d3-4185-ae66-020b84cabd60" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-quobyte-79dfd520-e3d3-4185-ae66-020b84cabd60" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:36 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960" returned: 0 in 0.421s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[73179513-e9ed-4e9f-a1f4-4a37ab1a2183]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-79dfd520-e3d3-4185-ae66-020b84cabd60 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:36 devstack sudo[106193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960
Sep 29 12:43:36 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:36 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-79dfd520-e3d3-4185-ae66-020b84cabd60
Sep 29 12:43:36 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:37 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 1073741824" returned: 0 in 0.588s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:37 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-99cc46d4-d773-46ae-a3ce-49c07f1a6960" returned: 0 in 0.336s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-quobyte-99cc46d4-d773-46ae-a3ce-49c07f1a6960" released by "delete_volume" :: held 0.834s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:37 devstack sudo[106205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4
Sep 29 12:43:37 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:37 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-79dfd520-e3d3-4185-ae66-020b84cabd60" returned: 0 in 0.419s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-79dfd520-e3d3-4185-ae66-020b84cabd60 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Created reservations ['d39c9575-399b-4171-ad55-138eca0aa7bb', '39893a94-4cba-4284-b482-2af33c305bda', '3f39e530-9de5-48dc-a75a-acedaf206800', '352691ec-6122-4bb1-a841-0f12edc64436'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:37 devstack sudo[106207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-79dfd520-e3d3-4185-ae66-020b84cabd60
Sep 29 12:43:37 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:37 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:37 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:37 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4" returned: 0 in 0.324s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a310c2a-7320-41cf-b786-b220d848f8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d020fa1-c0da-4274-9cad-1bd1377616f4', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf4b5d6-bfda-4499-9544-fccaa2e20920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:37 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Volume volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 (4d020fa1-c0da-4274-9cad-1bd1377616f4): created successfully
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf4b5d6-bfda-4499-9544-fccaa2e20920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Flow 'volume_create_manager' (dde70922-760b-49da-a7e6-8f0b293d87c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:37 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-79dfd520-e3d3-4185-ae66-020b84cabd60" returned: 0 in 0.378s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-quobyte-79dfd520-e3d3-4185-ae66-020b84cabd60" released by "delete_volume" :: held 0.867s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0bf0e730-37b7-4832-8c51-e3659e74dc2a tempest-VolumeDependencyTests-1042137486 None] Created volume successfully.
Sep 29 12:43:37 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.317s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Deleted volume successfully.
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c67b5b9b-e1b3-4b9b-9f35-ff0d63a92baa tempest-CreateVolumesFromSnapshotTest-1718423760 None] Lock "cinder-99cc46d4-d773-46ae-a3ce-49c07f1a6960-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Created reservations ['42b83b08-af7b-406a-8524-ace6100250e6', 'c09ce4ed-ad21-4ae6-b200-60639547f3dd', '38472d16-702c-4bc8-ab9f-afa7e2f17c2c', '04d63fbf-fee6-4af6-bd42-d9d674ac27b9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:37 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:37 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "cinder-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] Creating offline snapshot e961a941-44ec-4a78-a1c2-dc956acf960f of volume 31b911d2-3c16-4ed0-a54b-b6e354467981 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[594bc9a2-3d9d-4576-a432-12e1061468fb]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "cinder-quobyte-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-quobyte-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c" acquired by "delete_volume" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[91de2d12-5424-4373-8278-b8fff6964a42]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:38 devstack sudo[106216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981
Sep 29 12:43:38 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:38 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Deleted volume successfully.
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b9ed2bb5-059e-4e3d-a634-4d86041a6caa tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-79dfd520-e3d3-4185-ae66-020b84cabd60-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:38 devstack sudo[106217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c
Sep 29 12:43:38 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:38 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981" returned: 0 in 0.453s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:38 devstack sudo[106225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f 1G
Sep 29 12:43:38 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:38 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c" returned: 0 in 0.479s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:38 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c
Sep 29 12:43:38 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:38 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-quobyte-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c" released by "delete_volume" :: held 0.859s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:38 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Created reservations ['5ee07640-1c3d-4542-b226-b812808251e1', 'b52510ee-6f1d-46e3-8501-419221098f98', '2005dadc-c665-4661-92e4-fcc6a00231c7', 'a4d8da07-cce4-474f-bf5c-3821ee101d17'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:38 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f 1G" returned: 0 in 0.564s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b911d2-3c16-4ed0-a54b-b6e354467981 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:39 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b911d2-3c16-4ed0-a54b-b6e354467981 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f
Sep 29 12:43:39 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:39 devstack sudo[106240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:39 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "cinder-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "cinder-quobyte-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-quobyte-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7633dba7-0bbc-4773-b345-6ef015af204e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:39 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.340s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:39 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Deleted volume successfully.
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b911d2-3c16-4ed0-a54b-b6e354467981 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f" returned: 0 in 0.460s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:39 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f is being set with open permissions: ugo+rw
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:39 devstack sudo[106244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1
Sep 29 12:43:39 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-8391e6b6-675e-445c-bb68-fa2af8dc0292 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-7a2b18a0-4ecb-4bb2-85dd-d4e9d14ee38c-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:39 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f
Sep 29 12:43:39 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:39 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:39 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1" returned: 0 in 0.417s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:39 devstack sudo[106255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1
Sep 29 12:43:39 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:39 devstack sudo[106257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.info
Sep 29 12:43:39 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:40 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1" returned: 0 in 0.291s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-quobyte-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1" released by "delete_volume" :: held 0.772s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:40 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.info" returned: 0 in 0.333s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:40 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.info is being set with open permissions: ugo+rw
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Created reservations ['68554f2d-ce88-4ac9-b569-5781587036bf', 'e486609d-fd4e-40d9-ac0e-fba471eba6d9', '911441ed-948a-4eec-a2e3-7f285d94d12f', '496f9d49-1e6d-4103-80ed-34cb0eca1953'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:40 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.info
Sep 29 12:43:40 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:40 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:40 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:40 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "cinder-d909e5a8-c466-4828-9b2d-c87c34c31688-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.info" returned: 0 in 0.279s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.580s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-d909e5a8-c466-4828-9b2d-c87c34c31688-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] Creating offline snapshot 8f4f5d0d-9901-4a16-81cd-83c2afb725e7 of volume 4d020fa1-c0da-4274-9cad-1bd1377616f4 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:43:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9bf2b10b-3b1a-4c04-a207-508571193206 tempest-ProjectMemberTests-222694199 None] Create snapshot completed successfully
Sep 29 12:43:40 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.290s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:40 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Deleted volume successfully.
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[71abba51-511c-467f-9bab-fdf73e810dd5]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "cinder-quobyte-d909e5a8-c466-4828-9b2d-c87c34c31688" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b6c032bd-9565-40d6-a40e-e1f48ae104f7 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-f19bdf0d-db6b-47a9-a984-0354f0cf0eb1-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-quobyte-d909e5a8-c466-4828-9b2d-c87c34c31688" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74f410e-1b7c-491e-b326-313126924070]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d909e5a8-c466-4828-9b2d-c87c34c31688 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:40 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4
Sep 29 12:43:40 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:40 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d909e5a8-c466-4828-9b2d-c87c34c31688
Sep 29 12:43:40 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:40 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4" returned: 0 in 0.426s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:40 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7 1G
Sep 29 12:43:40 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:41 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d909e5a8-c466-4828-9b2d-c87c34c31688" returned: 0 in 0.489s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d909e5a8-c466-4828-9b2d-c87c34c31688 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-e961a941-44ec-4a78-a1c2-dc956acf960f-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:41 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d909e5a8-c466-4828-9b2d-c87c34c31688
Sep 29 12:43:41 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Lock "cinder-e961a941-44ec-4a78-a1c2-dc956acf960f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-31b911d2-3c16-4ed0-a54b-b6e354467981" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-31b911d2-3c16-4ed0-a54b-b6e354467981" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-e961a941-44ec-4a78-a1c2-dc956acf960f" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-e961a941-44ec-4a78-a1c2-dc956acf960f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Deleting offline snapshot e961a941-44ec-4a78-a1c2-dc956acf960f of volume 31b911d2-3c16-4ed0-a54b-b6e354467981 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] snapshot_file for this snap is: volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc8b0ff-1263-4431-be17-053edcd78b5c]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:41 devstack sudo[106284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f
Sep 29 12:43:41 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:41 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d909e5a8-c466-4828-9b2d-c87c34c31688" returned: 0 in 0.363s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-quobyte-d909e5a8-c466-4828-9b2d-c87c34c31688" released by "delete_volume" :: held 0.902s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:41 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7 1G" returned: 0 in 0.539s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:41 devstack sudo[106288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7
Sep 29 12:43:41 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Created reservations ['a6265e34-f75b-4c1b-8b9f-c45a1539202d', '93beb3c9-8178-408a-847a-79decd09c307', 'e5f6bf1f-42c9-4251-aaad-8f87de810281', 'a71d2566-1e90-4535-bbca-4a92ccc98d13'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:41 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:41 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:41 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f" returned: 0 in 0.471s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b911d2-3c16-4ed0-a54b-b6e354467981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e32f3a-d480-4885-822a-0a03d60e3b59]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:41 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7" returned: 0 in 0.386s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:41 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7 is being set with open permissions: ugo+rw
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:41 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981
Sep 29 12:43:41 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:41 devstack sudo[106299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7
Sep 29 12:43:41 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:41 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.304s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:41 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Deleted volume successfully.
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ec84070c-3711-4e10-9043-2c1a3d2d6257 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-d909e5a8-c466-4828-9b2d-c87c34c31688-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:42 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7" returned: 0 in 0.269s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:42 devstack sudo[106308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.info
Sep 29 12:43:42 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:42 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981" returned: 0 in 0.485s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:42 devstack sudo[106310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f
Sep 29 12:43:42 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:42 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.info" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:42 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.info is being set with open permissions: ugo+rw
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:42 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.info
Sep 29 12:43:42 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:42 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f" returned: 0 in 0.377s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:42 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f
Sep 29 12:43:42 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "cinder-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "cinder-quobyte-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:42 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-quobyte-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.info" returned: 0 in 0.352s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.390s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[114fa7e8-6dec-4789-ae08-843439e3fb38]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:42 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-dc4446c8-d2a1-4793-a5e7-2c05bbadd09c tempest-VolumeDependencyTests-1042137486 None] Create snapshot completed successfully
Sep 29 12:43:42 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981.e961a941-44ec-4a78-a1c2-dc956acf960f" returned: 0 in 0.343s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:42 devstack sudo[106321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5
Sep 29 12:43:42 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-e961a941-44ec-4a78-a1c2-dc956acf960f" released by "_delete_snapshot" :: held 1.820s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-31b911d2-3c16-4ed0-a54b-b6e354467981" released by "delete_snapshot" :: held 1.844s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Created reservations ['75ea774b-c73a-46ac-afbd-7e44b7bc06c6', 'f7907c1b-96c9-4ac8-a351-11902bc3c1d5', '43c9c437-6212-4218-ae2c-d88c7129fcae', '8777556e-01b5-44cf-b1a0-511c4d484682'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:43 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Delete snapshot completed successfully.
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-83965c75-0e8d-4a4a-af7b-fde000c206e5 tempest-ProjectMemberTests-222694199 None] Lock "cinder-e961a941-44ec-4a78-a1c2-dc956acf960f-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:43 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5" returned: 0 in 0.477s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:43 devstack sudo[106327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5
Sep 29 12:43:43 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:43 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5" returned: 0 in 0.313s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-31b911d2-3c16-4ed0-a54b-b6e354467981-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-quobyte-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5" released by "delete_volume" :: held 0.875s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Lock "cinder-31b911d2-3c16-4ed0-a54b-b6e354467981-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Flow 'volume_create_manager' (a895f4ba-c234-46b1-b603-858706b971e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4730074b-d7ad-4e83-90f6-b82d1147c493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4730074b-d7ad-4e83-90f6-b82d1147c493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-43327900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9024187-f79e-48d5-b5c4-7a4d4ea1d39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b1b4bd6b6345398cdb8ddae5d8cf78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8f4f5d0d-9901-4a16-81cd-83c2afb725e7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:44Z,use_quota=True,user_id='28f3ac4b71a246c398ad1c91a82427a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b955aeea-798a-4308-b014-06bb5d764b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b955aeea-798a-4308-b014-06bb5d764b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28302766-a04e-4442-abfb-2ff441bbb87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28302766-a04e-4442-abfb-2ff441bbb87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9024187-f79e-48d5-b5c4-7a4d4ea1d39e', 'volume_name': 'volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e', 'volume_size': 1, 'snapshot_id': '8f4f5d0d-9901-4a16-81cd-83c2afb725e7'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9063b99a-9d2c-4076-9687-95b2d7ab347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9063b99a-9d2c-4076-9687-95b2d7ab347c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861b0604-6d8f-4300-aa03-7c4387f889a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:43 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Volume a9024187-f79e-48d5-b5c4-7a4d4ea1d39e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e', 'volume_size': 1, 'snapshot_id': '8f4f5d0d-9901-4a16-81cd-83c2afb725e7'}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-31b911d2-3c16-4ed0-a54b-b6e354467981" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "cinder-quobyte-8f4f5d0d-9901-4a16-81cd-83c2afb725e7-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Created reservations ['6b9b61e0-77a7-4816-8e4e-38cd11fb0e6e', 'e771c2a2-77ed-4b3c-9382-ee99f14f2692', '06b995c0-bcec-4051-ae92-fa053d36bbf5', 'cd15d830-0ea9-4eb8-94df-f74585e8994a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-31b911d2-3c16-4ed0-a54b-b6e354467981" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-quobyte-8f4f5d0d-9901-4a16-81cd-83c2afb725e7-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Creating volume a9024187-f79e-48d5-b5c4-7a4d4ea1d39e from snapshot 8f4f5d0d-9901-4a16-81cd-83c2afb725e7 {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "cinder-quobyte-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12db530-e306-45cf-9739-2258f392b8eb]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-quobyte-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] snapshot: 8f4f5d0d-9901-4a16-81cd-83c2afb725e7, volume: a9024187-f79e-48d5-b5c4-7a4d4ea1d39e,  {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[82194446-0691-4bd6-963e-e0de32318eed]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:44 devstack sudo[106330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981
Sep 29 12:43:44 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:44 devstack sudo[106333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:44 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:44 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7
Sep 29 12:43:44 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Flow 'volume_create_manager' (39d373b9-0ada-468d-b13b-99627989fccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9959f365-9c58-4653-8ab9-954151154aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9959f365-9c58-4653-8ab9-954151154aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90c9956-b4ac-4f85-b7cb-68c5cf69128d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20fbe127b3e3410f9ebdcfe8aea0af85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:44Z,use_quota=True,user_id='afd75d9f285a4697bb65d82cd70bfba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:44 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30fb17e9-8700-4c5c-aa0d-013dd2d790c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30fb17e9-8700-4c5c-aa0d-013dd2d790c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2b7fb0-3da4-45c9-8c6f-a3aee5ab0294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.image.glance [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Creating Keystone auth plugin from conf {{(pid=86369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981" returned: 0 in 0.507s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:44 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.327s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Deleted volume successfully.
Sep 29 12:43:44 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981
Sep 29 12:43:44 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7132619b-7d36-4a24-95a4-58b68ba4b231 tempest-CreateVolumesFromImageTest-1442870843 None] Lock "cinder-ce37b86a-3af3-4ae8-8789-fc5a63e0eea5-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:44 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d020fa1-c0da-4274-9cad-1bd1377616f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06ceaa9-17eb-497a-8256-6851fbf2e304]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:44 devstack sudo[106346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4
Sep 29 12:43:44 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2b7fb0-3da4-45c9-8c6f-a3aee5ab0294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd90c9956-b4ac-4f85-b7cb-68c5cf69128d', 'volume_name': 'volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d', 'volume_size': 1, 'image_id': '230d4771-de90-417f-81f0-a9cfda6118f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/230d4771-de90-417f-81f0-a9cfda6118f4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a617b842bc3c003a3b19bbf7332b444c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20fbe127b3e3410f9ebdcfe8aea0af85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '70049c86499b61cbdbecf0d373ae6a248048572c42647b4293b2306f8d838a80bcc11d40d9d13ccf6c45c3fded34b7a981dd7af1f025afc66a245ea22105b633', 'id': '230d4771-de90-417f-81f0-a9cfda6118f4', 'created_at': datetime.datetime(2026, 9, 29, 10, 43, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 43, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/230d4771-de90-417f-81f0-a9cfda6118f4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701aea06b0>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3252a0f6-c193-4670-9a01-cefe88a8aa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3252a0f6-c193-4670-9a01-cefe88a8aa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b7a282-0e6e-4557-97c2-dc4a48359936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:44 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Volume d90c9956-b4ac-4f85-b7cb-68c5cf69128d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d', 'volume_size': 1, 'image_id': '230d4771-de90-417f-81f0-a9cfda6118f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/230d4771-de90-417f-81f0-a9cfda6118f4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a617b842bc3c003a3b19bbf7332b444c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20fbe127b3e3410f9ebdcfe8aea0af85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '70049c86499b61cbdbecf0d373ae6a248048572c42647b4293b2306f8d838a80bcc11d40d9d13ccf6c45c3fded34b7a981dd7af1f025afc66a245ea22105b633', 'id': '230d4771-de90-417f-81f0-a9cfda6118f4', 'created_at': datetime.datetime(2026, 9, 29, 10, 43, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 43, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/230d4771-de90-417f-81f0-a9cfda6118f4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701aea06b0>}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Trying to clone d90c9956-b4ac-4f85-b7cb-68c5cf69128d from image 230d4771-de90-417f-81f0-a9cfda6118f4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/230d4771-de90-417f-81f0-a9cfda6118f4', 'metadata': {}}]). {{(pid=86369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 12:43:44 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-31b911d2-3c16-4ed0-a54b-b6e354467981" returned: 0 in 0.325s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-31b911d2-3c16-4ed0-a54b-b6e354467981" released by "delete_volume" :: held 0.931s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 12:43:44 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Image download 0.00 MB at 0.00 MB/s
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Created reservations ['594f2891-6289-4044-a51d-3c8aea168639', '7d310cc1-5ec5-4681-b4e4-706ed0922a33', '16938f3e-1620-4f81-8897-3872fa8f2c04', '605bdb04-ed8e-4014-959b-69222197e257'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed92f447-9bac-40c9-837a-f2bc57840c00]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:45 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4" returned: 0 in 0.455s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Path /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:45 devstack sudo[106354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e
Sep 29 12:43:45 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:45 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD
Sep 29 12:43:45 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:45 devstack sudo[106355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:45 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:45 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:45 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.304s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:45 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Deleted volume successfully.
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-63307451-78b1-4b24-9f74-94a99c596597 tempest-ProjectMemberTests-222694199 None] Lock "cinder-31b911d2-3c16-4ed0-a54b-b6e354467981-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:45 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD
Sep 29 12:43:45 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:45 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD" returned: 1 in 0.621s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:43:45 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Temporary image 230d4771-de90-417f-81f0-a9cfda6118f4 is fetched for user afd75d9f285a4697bb65d82cd70bfba8. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 12:43:46 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[946f2133-8221-4c6f-af90-4363e653d65d]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:46 devstack sudo[106377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD
Sep 29 12:43:46 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:46 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD" returned: 0 in 0.611s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:47 devstack sudo[106381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD
Sep 29 12:43:47 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (96f4e762-f3a0-477b-b3d6-c44a359476fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910ce45f-1d3a-49b3-b965-3f4bca388ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910ce45f-1d3a-49b3-b965-3f4bca388ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614913497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aae35b9-ab6d-43d5-95af-461c842e2f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:47Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92916956-e0e5-4c77-97ed-6018cef9f6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92916956-e0e5-4c77-97ed-6018cef9f6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4566a237-cae2-4a91-b57f-cea854867a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4566a237-cae2-4a91-b57f-cea854867a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aae35b9-ab6d-43d5-95af-461c842e2f66', 'volume_name': 'volume-9aae35b9-ab6d-43d5-95af-461c842e2f66', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176eb36d-d0b2-422c-b31a-433e52677b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176eb36d-d0b2-422c-b31a-433e52677b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce9fb37-1aef-4751-ad15-d75d05427731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:47 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Volume 9aae35b9-ab6d-43d5-95af-461c842e2f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aae35b9-ab6d-43d5-95af-461c842e2f66', 'volume_size': 1}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:47 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD" returned: 1 in 0.687s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:43:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:52 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" returned: 0 in 7.586s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4, size 1024.00 MB, duration 7.59 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:43:52 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Converted 1024.00 MB image at 134.97 MB/s
Sep 29 12:43:52 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e is being set with open permissions: ugo+rw
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:52 devstack sudo[106386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e
Sep 29 12:43:52 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:52 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" returned: 0 in 0.245s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-quobyte-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" released by "_copy_volume_from_snapshot" :: held 8.888s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-quobyte-8f4f5d0d-9901-4a16-81cd-83c2afb725e7-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" released by "_create_volume_from_snapshot" :: held 8.969s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.036s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.531s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614913497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aae35b9-ab6d-43d5-95af-461c842e2f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:47Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Creating volume 9aae35b9-ab6d-43d5-95af-461c842e2f66 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:52 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:52 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66 1073741824
Sep 29 12:43:52 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861b0604-6d8f-4300-aa03-7c4387f889a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e', 'volume_size': 1, 'snapshot_id': '8f4f5d0d-9901-4a16-81cd-83c2afb725e7'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7563ba1b-a97e-4401-a28e-ab389037a012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:52 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Volume volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e (a9024187-f79e-48d5-b5c4-7a4d4ea1d39e): created successfully
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7563ba1b-a97e-4401-a28e-ab389037a012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:52 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Flow 'volume_create_manager' (a895f4ba-c234-46b1-b603-858706b971e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-e5f0138e-bb2e-4358-bb96-0a69de1d2cf4 tempest-VolumeDependencyTests-1042137486 None] Created volume successfully.
Sep 29 12:43:53 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66 1073741824" returned: 0 in 0.478s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:53 devstack sudo[106395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66
Sep 29 12:43:53 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "cinder-8f4f5d0d-9901-4a16-81cd-83c2afb725e7-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-8f4f5d0d-9901-4a16-81cd-83c2afb725e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "cinder-quobyte-4d020fa1-c0da-4274-9cad-1bd1377616f4" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-quobyte-4d020fa1-c0da-4274-9cad-1bd1377616f4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "cinder-quobyte-8f4f5d0d-9901-4a16-81cd-83c2afb725e7" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-quobyte-8f4f5d0d-9901-4a16-81cd-83c2afb725e7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Deleting offline snapshot 8f4f5d0d-9901-4a16-81cd-83c2afb725e7 of volume 4d020fa1-c0da-4274-9cad-1bd1377616f4 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:43:53 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] snapshot_file for this snap is: volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66" returned: 0 in 0.313s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.272s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90c9956-b4ac-4f85-b7cb-68c5cf69128d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20fbe127b3e3410f9ebdcfe8aea0af85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:43:44Z,use_quota=True,user_id='afd75d9f285a4697bb65d82cd70bfba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Creating volume d90c9956-b4ac-4f85-b7cb-68c5cf69128d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:43:53 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3c0f72-13d0-47ed-8484-d0103d4da0de]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:53 devstack sudo[106398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d 1073741824
Sep 29 12:43:53 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce9fb37-1aef-4751-ad15-d75d05427731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aae35b9-ab6d-43d5-95af-461c842e2f66', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d36cb12-f21e-4ecc-8230-3d8b30079f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:53 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Volume volume-9aae35b9-ab6d-43d5-95af-461c842e2f66 (9aae35b9-ab6d-43d5-95af-461c842e2f66): created successfully
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d36cb12-f21e-4ecc-8230-3d8b30079f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:53 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (96f4e762-f3a0-477b-b3d6-c44a359476fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-acf40473-185e-4e79-8fb2-efa70dcd55ba tempest-ProjectMemberTests-222694199 None] Created volume successfully.
Sep 29 12:43:53 devstack sudo[106399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7
Sep 29 12:43:53 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:54 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7" returned: 0 in 0.470s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d020fa1-c0da-4274-9cad-1bd1377616f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ebe008-bfb7-4224-8f98-c6b786eabe01]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:54 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d 1073741824" returned: 0 in 0.589s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:54 devstack sudo[106409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4
Sep 29 12:43:54 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:54 devstack sudo[106410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d
Sep 29 12:43:54 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:54 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d" returned: 0 in 0.324s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Attempting download of 230d4771-de90-417f-81f0-a9cfda6118f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/230d4771-de90-417f-81f0-a9cfda6118f4', 'metadata': {}}])) to volume d90c9956-b4ac-4f85-b7cb-68c5cf69128d. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2df29c-cc9e-4706-8416-c4b9ef41d222]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_230d4771-de90-417f-81f0-a9cfda6118f4_89u1c9eo {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] Creating offline snapshot cc07f703-b0b7-438f-a9f2-17e6d5a7dc14 of volume 9aae35b9-ab6d-43d5-95af-461c842e2f66 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b516db97-d61a-473c-988e-75457ee050ab]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:54 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4" returned: 0 in 0.681s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:54 devstack sudo[106417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_230d4771-de90-417f-81f0-a9cfda6118f4_89u1c9eo
Sep 29 12:43:54 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:55 devstack sudo[106420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7
Sep 29 12:43:55 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:55 devstack sudo[106419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66
Sep 29 12:43:55 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:55 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_230d4771-de90-417f-81f0-a9cfda6118f4_89u1c9eo" returned: 0 in 0.427s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_230d4771-de90-417f-81f0-a9cfda6118f4_89u1c9eo {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:55 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66" returned: 0 in 0.479s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:55 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7" returned: 0 in 0.435s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:55 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_230d4771-de90-417f-81f0-a9cfda6118f4_89u1c9eo
Sep 29 12:43:55 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:55 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14 1G
Sep 29 12:43:55 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:55 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7
Sep 29 12:43:55 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:55 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_230d4771-de90-417f-81f0-a9cfda6118f4_89u1c9eo" returned: 1 in 0.378s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_230d4771-de90-417f-81f0-a9cfda6118f4_89u1c9eo' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[457835aa-ba4b-48a7-838a-434cda889759]: (4, 'raw') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:55 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4.8f4f5d0d-9901-4a16-81cd-83c2afb725e7" returned: 0 in 0.339s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-quobyte-8f4f5d0d-9901-4a16-81cd-83c2afb725e7" released by "_delete_snapshot" :: held 2.106s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:55 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-quobyte-4d020fa1-c0da-4274-9cad-1bd1377616f4" released by "delete_snapshot" :: held 2.140s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:55 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Created reservations ['5a2374f1-6197-4887-a259-fb46aaecea66', '24ff464d-75d4-4885-a0a1-fed4a88732d9', 'e79acc54-97dc-451d-8769-9cec415661eb', '2f66428e-4095-4fac-b5b3-c0192ce2b5c4'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:55 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14 1G" returned: 0 in 0.553s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aae35b9-ab6d-43d5-95af-461c842e2f66 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:55 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aae35b9-ab6d-43d5-95af-461c842e2f66 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14
Sep 29 12:43:55 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:56 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Delete snapshot completed successfully.
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3c078486-400b-41e9-a97c-1dd7746830bd tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-8f4f5d0d-9901-4a16-81cd-83c2afb725e7-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:56 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:56 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD
Sep 29 12:43:56 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:56 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aae35b9-ab6d-43d5-95af-461c842e2f66 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:56 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14 is being set with open permissions: ugo+rw
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:56 devstack sudo[106457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14
Sep 29 12:43:56 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:56 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] 230d4771-de90-417f-81f0-a9cfda6118f4 was raw, converting to qcow2 {{(pid=86369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:56 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d
Sep 29 12:43:56 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:56 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14" returned: 0 in 0.269s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:56 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.info
Sep 29 12:43:56 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "cinder-4d020fa1-c0da-4274-9cad-1bd1377616f4-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:56 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.info" returned: 0 in 0.367s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:56 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.info is being set with open permissions: ugo+rw
Sep 29 12:43:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-4d020fa1-c0da-4274-9cad-1bd1377616f4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:57 devstack sudo[106479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.info
Sep 29 12:43:57 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "cinder-quobyte-4d020fa1-c0da-4274-9cad-1bd1377616f4" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-quobyte-4d020fa1-c0da-4274-9cad-1bd1377616f4" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:57 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d" returned: 0 in 0.661s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_230d4771-de90-417f-81f0-a9cfda6118f4_4h6vhe5rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:43:57 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Converted 0.00 MB image at 0.00 MB/s
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1724b859-5e3f-496d-827a-2561f129b4c6]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:57 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d 1G
Sep 29 12:43:57 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:57 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4
Sep 29 12:43:57 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:57 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.info" returned: 0 in 0.327s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.510s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d2239f48-aca4-4929-a41b-e2c25763428c tempest-ProjectMemberTests-222694199 None] Create snapshot completed successfully
Sep 29 12:43:57 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d 1G" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Downloaded image 230d4771-de90-417f-81f0-a9cfda6118f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/230d4771-de90-417f-81f0-a9cfda6118f4', 'metadata': {}}])) to volume d90c9956-b4ac-4f85-b7cb-68c5cf69128d successfully. {{(pid=86369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Temporary image 230d4771-de90-417f-81f0-a9cfda6118f4 for user afd75d9f285a4697bb65d82cd70bfba8 is deleted. {{(pid=86369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.volume.volume_utils [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Marking volume d90c9956-b4ac-4f85-b7cb-68c5cf69128d as bootable. {{(pid=86369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Copying metadata from image 230d4771-de90-417f-81f0-a9cfda6118f4 to d90c9956-b4ac-4f85-b7cb-68c5cf69128d. {{(pid=86369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Creating volume glance metadata for volume d90c9956-b4ac-4f85-b7cb-68c5cf69128d backed by image 230d4771-de90-417f-81f0-a9cfda6118f4 with: {'image_id': '230d4771-de90-417f-81f0-a9cfda6118f4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a617b842bc3c003a3b19bbf7332b444c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 12:43:57 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4" returned: 0 in 0.446s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:57 devstack sudo[106492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4
Sep 29 12:43:57 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b7a282-0e6e-4557-97c2-dc4a48359936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d', 'volume_size': 1, 'image_id': '230d4771-de90-417f-81f0-a9cfda6118f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/230d4771-de90-417f-81f0-a9cfda6118f4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a617b842bc3c003a3b19bbf7332b444c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20fbe127b3e3410f9ebdcfe8aea0af85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '70049c86499b61cbdbecf0d373ae6a248048572c42647b4293b2306f8d838a80bcc11d40d9d13ccf6c45c3fded34b7a981dd7af1f025afc66a245ea22105b633', 'id': '230d4771-de90-417f-81f0-a9cfda6118f4', 'created_at': datetime.datetime(2026, 9, 29, 10, 43, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 10, 43, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/230d4771-de90-417f-81f0-a9cfda6118f4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b701aea06b0>}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25804549-af25-4a70-8aef-bcc252fc9fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:43:57 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Volume volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d (d90c9956-b4ac-4f85-b7cb-68c5cf69128d): created successfully
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25804549-af25-4a70-8aef-bcc252fc9fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Flow 'volume_create_manager' (39d373b9-0ada-468d-b13b-99627989fccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:43:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7548b539-0ee5-414c-abd4-3916a080e79d tempest-VolumeImageDependencyTests-1894939723 None] Created volume successfully.
Sep 29 12:43:57 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4d020fa1-c0da-4274-9cad-1bd1377616f4" returned: 0 in 0.298s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-quobyte-4d020fa1-c0da-4274-9cad-1bd1377616f4" released by "delete_volume" :: held 0.845s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Created reservations ['b983ad5f-7e0b-40a3-aa42-f2c517cac6dd', 'a5c6056c-7915-41a1-8258-5d2eae4a9227', '1f582a3f-0dd2-4517-b4cd-ed7901aee47f', '486c4d50-d683-44b9-8ad3-195068c4fb99'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-cc07f703-b0b7-438f-a9f2-17e6d5a7dc14-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Lock "cinder-cc07f703-b0b7-438f-a9f2-17e6d5a7dc14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-9aae35b9-ab6d-43d5-95af-461c842e2f66" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-9aae35b9-ab6d-43d5-95af-461c842e2f66" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-cc07f703-b0b7-438f-a9f2-17e6d5a7dc14" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-cc07f703-b0b7-438f-a9f2-17e6d5a7dc14" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Deleting offline snapshot cc07f703-b0b7-438f-a9f2-17e6d5a7dc14 of volume 9aae35b9-ab6d-43d5-95af-461c842e2f66 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] snapshot_file for this snap is: volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b31c7c5-2b91-4021-b366-8a854f3f868d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "cinder-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:58 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:58 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "cinder-quobyte-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:58 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14
Sep 29 12:43:58 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-quobyte-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4ed65d-f38d-4504-8452-5e9aef6a53c7]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:58 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:58 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e
Sep 29 12:43:58 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.322s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:58 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Deleted volume successfully.
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fbb56b32-e866-492e-a326-05859a811229 tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-4d020fa1-c0da-4274-9cad-1bd1377616f4-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:58 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14" returned: 0 in 0.575s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aae35b9-ab6d-43d5-95af-461c842e2f66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f9c67-39af-4a0c-ba38-97e9327e9853]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Acquiring lock "cinder-d90c9956-b4ac-4f85-b7cb-68c5cf69128d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:58 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" returned: 0 in 0.514s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:58 devstack sudo[106544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e
Sep 29 12:43:58 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:58 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Lock "cinder-d90c9956-b4ac-4f85-b7cb-68c5cf69128d-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:59 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66
Sep 29 12:43:59 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Acquiring lock "cinder-quobyte-d90c9956-b4ac-4f85-b7cb-68c5cf69128d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Lock "cinder-quobyte-d90c9956-b4ac-4f85-b7cb-68c5cf69128d" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa51b9d9-1769-42ae-9d5b-ac82eac146d6]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:59 devstack sudo[106547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d
Sep 29 12:43:59 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:59 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" returned: 0 in 0.486s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-quobyte-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e" released by "delete_volume" :: held 1.070s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:43:59 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66" returned: 0 in 0.636s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:59 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14
Sep 29 12:43:59 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Created reservations ['26d2551c-5840-479e-9490-f498ff22cc29', '97dd4805-9594-478c-943e-f6d379f6c9a9', 'fbbf8929-399f-47f2-96d2-def0771b40a9', '19f518d0-3b9b-488e-a865-839217b15682'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:59 devstack sudo[106561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:43:59 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:59 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d" returned: 0 in 0.579s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:59 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d
Sep 29 12:43:59 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:59 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14" returned: 0 in 0.422s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:43:59 devstack sudo[106569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14
Sep 29 12:43:59 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:43:59 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.309s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:43:59 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Deleted volume successfully.
Sep 29 12:43:59 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-957420a1-3f0c-4116-89e3-abe7c4461065 tempest-VolumeDependencyTests-1042137486 None] Lock "cinder-a9024187-f79e-48d5-b5c4-7a4d4ea1d39e-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:00 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d90c9956-b4ac-4f85-b7cb-68c5cf69128d" returned: 0 in 0.341s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Lock "cinder-quobyte-d90c9956-b4ac-4f85-b7cb-68c5cf69128d" released by "delete_volume" :: held 1.001s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Created reservations ['2ddaee5a-fa41-4c6e-b3e2-b0aa2b352ceb', '9b01ec37-2ff4-4d90-8584-8265b7ddd91d', 'f5b0d944-0ff7-418a-bf9e-19cbeccb52b0', '57fd43f7-7e3b-43a6-86d4-83b6bc0d8bb2'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:00 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66.cc07f703-b0b7-438f-a9f2-17e6d5a7dc14" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-cc07f703-b0b7-438f-a9f2-17e6d5a7dc14" released by "_delete_snapshot" :: held 2.114s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-9aae35b9-ab6d-43d5-95af-461c842e2f66" released by "delete_snapshot" :: held 2.151s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:00 devstack sudo[106574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:00 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Created reservations ['0c141b05-a785-4ea8-be2f-946db99812b1', 'ad8e1d28-cb07-4fa7-b4be-ce9b849be9ee', '8f2d1fc4-e9eb-496a-b1d0-788a61b49ab2', 'd07365de-a1dc-41fe-adb9-05341edf20b9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:00 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Delete snapshot completed successfully.
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f2a2c5ee-a8ab-420c-b643-032b6e2bf3e3 tempest-ProjectMemberTests-222694199 None] Lock "cinder-cc07f703-b0b7-438f-a9f2-17e6d5a7dc14-delete_snapshot" released by "delete_snapshot" :: held 2.395s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:00 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.280s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:00 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Deleted volume successfully.
Sep 29 12:44:00 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ea445a80-e4df-49f5-bb6e-bb87d185f1ad tempest-VolumeImageDependencyTests-1894939723 None] Lock "cinder-d90c9956-b4ac-4f85-b7cb-68c5cf69128d-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-9aae35b9-ab6d-43d5-95af-461c842e2f66-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Lock "cinder-9aae35b9-ab6d-43d5-95af-461c842e2f66-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:01 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=233,cinder:UPDATE=312,cinder:INSERT=97,cinder:DELETE=29 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:44:01 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=313,cinder:SELECT=232,cinder:INSERT=73,cinder:DELETE=26 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:44:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-9aae35b9-ab6d-43d5-95af-461c842e2f66" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:01 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-9aae35b9-ab6d-43d5-95af-461c842e2f66" acquired by "delete_volume" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:01 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85439be-6dc4-4906-a90b-24b7277f1c3d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:01 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:01 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66
Sep 29 12:44:01 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:02 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66" returned: 0 in 0.546s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:02 devstack sudo[106582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66
Sep 29 12:44:02 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:02 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-9aae35b9-ab6d-43d5-95af-461c842e2f66" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:02 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-9aae35b9-ab6d-43d5-95af-461c842e2f66" released by "delete_volume" :: held 1.039s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:02 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Created reservations ['1a88685a-1bd9-4ae6-ba38-d9e8b4d02ed2', '3d7ef256-6256-4b1e-b8e0-eb8a0829d211', 'e790c2a3-4cd9-42db-8a4b-a0814086a3d4', '56296fe4-6f0d-468b-b2dd-e709dd2a35fd'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:02 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:02 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:02 devstack sudo[106585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:02 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:02 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.304s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:03 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Deleted volume successfully.
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f24e34d4-b620-40a1-b1b7-2070a07e0182 tempest-ProjectMemberTests-222694199 None] Lock "cinder-9aae35b9-ab6d-43d5-95af-461c842e2f66-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Flow 'volume_create_manager' (310f38d5-b6c2-45eb-81d2-77281cd6d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140b5ad0-ff9c-4af7-8b01-07f4ee4569cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140b5ad0-ff9c-4af7-8b01-07f4ee4569cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19571904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a06559-4d24-4a61-8cd8-2a268eec8b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4b9d60c0554e6d852d22644f59710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:04Z,use_quota=True,user_id='ff292419227045368c3f611020093b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90419269-83e1-4e74-b83a-54577b2718b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90419269-83e1-4e74-b83a-54577b2718b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d7eb9d-7d29-4291-86a0-7766002ba6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d7eb9d-7d29-4291-86a0-7766002ba6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a06559-4d24-4a61-8cd8-2a268eec8b89', 'volume_name': 'volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aaed4db-99a9-4a6d-a169-bed289f260b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aaed4db-99a9-4a6d-a169-bed289f260b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0655672-5b7d-48e2-8f80-bd471534ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:03 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Volume f7a06559-4d24-4a61-8cd8-2a268eec8b89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89', 'volume_size': 1}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19571904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a06559-4d24-4a61-8cd8-2a268eec8b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4b9d60c0554e6d852d22644f59710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:04Z,use_quota=True,user_id='ff292419227045368c3f611020093b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Creating volume f7a06559-4d24-4a61-8cd8-2a268eec8b89 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:03 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:03 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:03 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89 1073741824
Sep 29 12:44:03 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (211cfe54-ef36-4572-a7e6-42de48350280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82db0e0-f954-4622-a47d-a3cc67c41507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82db0e0-f954-4622-a47d-a3cc67c41507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-475495106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:04Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016ef6b4-a22a-45e3-898a-bb504fcd9250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016ef6b4-a22a-45e3-898a-bb504fcd9250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a41f2d5-5fcc-47c9-ace6-5db8b643aced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a41f2d5-5fcc-47c9-ace6-5db8b643aced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39', 'volume_name': 'volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcdaf6d-7022-4757-a346-b26993ddfda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcdaf6d-7022-4757-a346-b26993ddfda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156a8416-a193-47b7-a89c-1d2d97540972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Volume 4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39', 'volume_size': 1}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:04 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89 1073741824" returned: 0 in 0.713s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:04 devstack sudo[106594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89
Sep 29 12:44:04 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Flow 'volume_create_manager' (9f36f25e-080d-43c7-83c7-c0f7ee6d2738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f627de4-ac62-49ec-b5a4-6f3129c455c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f627de4-ac62-49ec-b5a4-6f3129c455c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e265222-e8a6-4c83-a01f-cb617a898753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37fa8258264451aabac588a473af652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:05Z,use_quota=True,user_id='53c037008be142c4b2ae74b2c91ebf8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1cc373-f009-45a6-8e68-e0b38a76006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1cc373-f009-45a6-8e68-e0b38a76006d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04105f26-b3bf-4f86-a44b-545ac06c544e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04105f26-b3bf-4f86-a44b-545ac06c544e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e265222-e8a6-4c83-a01f-cb617a898753', 'volume_name': 'volume-0e265222-e8a6-4c83-a01f-cb617a898753', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37cb39c-c931-4dbf-8290-21916400471e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37cb39c-c931-4dbf-8290-21916400471e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bddfa3d-c8f1-42f0-b900-f44ffcc3085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:04 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Volume 0e265222-e8a6-4c83-a01f-cb617a898753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e265222-e8a6-4c83-a01f-cb617a898753', 'volume_size': 1}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:04 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.516s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-475495106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:04Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Creating volume 4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:04 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:05 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0655672-5b7d-48e2-8f80-bd471534ec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:05 devstack sudo[106598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 1073741824
Sep 29 12:44:05 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdbdf3b-254e-46ab-a4a6-2446eb91d07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Volume volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89 (f7a06559-4d24-4a61-8cd8-2a268eec8b89): created successfully
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdbdf3b-254e-46ab-a4a6-2446eb91d07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Flow 'volume_create_manager' (310f38d5-b6c2-45eb-81d2-77281cd6d50b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-76e9a7aa-2c50-4759-9e6d-115bc80c9083 tempest-ProjectReaderTests-871661053 None] Created volume successfully.
Sep 29 12:44:05 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 1073741824" returned: 0 in 0.455s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:05 devstack sudo[106605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39
Sep 29 12:44:05 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-97ac2ffb-f928-4f1b-b5c0-8e50d7099ea3 tempest-ProjectAdminTests-1824045366 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.0505638122559, 'free_capacity_gb': 1775.0505638122559, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86369) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 29 12:44:05 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e265222-e8a6-4c83-a01f-cb617a898753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37fa8258264451aabac588a473af652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:05Z,use_quota=True,user_id='53c037008be142c4b2ae74b2c91ebf8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Creating volume 0e265222-e8a6-4c83-a01f-cb617a898753 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:05 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0e265222-e8a6-4c83-a01f-cb617a898753 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:05 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0e265222-e8a6-4c83-a01f-cb617a898753 1073741824
Sep 29 12:44:05 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156a8416-a193-47b7-a89c-1d2d97540972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c43a7aa-687a-49d8-ba4e-072a130b50ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:05 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Volume volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 (4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39): created successfully
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c43a7aa-687a-49d8-ba4e-072a130b50ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:05 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (211cfe54-ef36-4572-a7e6-42de48350280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:05 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3014dff8-ca09-432a-84c5-2b478bfc03c4 tempest-ProjectMemberTests-222694199 None] Created volume successfully.
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:06 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0e265222-e8a6-4c83-a01f-cb617a898753 1073741824" returned: 0 in 0.518s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0e265222-e8a6-4c83-a01f-cb617a898753 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:06 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0e265222-e8a6-4c83-a01f-cb617a898753
Sep 29 12:44:06 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:06 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0e265222-e8a6-4c83-a01f-cb617a898753" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.633s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bddfa3d-c8f1-42f0-b900-f44ffcc3085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e265222-e8a6-4c83-a01f-cb617a898753', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a525fd-bf8d-4476-855e-70fcb8070d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] Creating offline snapshot a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3 of volume f7a06559-4d24-4a61-8cd8-2a268eec8b89 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:44:06 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Volume volume-0e265222-e8a6-4c83-a01f-cb617a898753 (0e265222-e8a6-4c83-a01f-cb617a898753): created successfully
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a525fd-bf8d-4476-855e-70fcb8070d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Flow 'volume_create_manager' (9f36f25e-080d-43c7-83c7-c0f7ee6d2738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ffce37-531f-4fdc-bc24-efd8828874bb]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:06 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:06 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f289c69a-6220-448a-ae97-87103d285c55 tempest-CinderUnicodeTest-1013839484 None] Created volume successfully.
Sep 29 12:44:06 devstack sudo[106617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89
Sep 29 12:44:06 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:07 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89" returned: 0 in 0.458s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:07 devstack sudo[106622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3 1G
Sep 29 12:44:07 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:07 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Flow 'volume_create_manager' (179c0006-dad8-4e6b-9336-93b0cf84f6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ddbc6e-7eef-4efd-bfd2-1d3ff33da30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3 1G" returned: 0 in 0.527s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:07 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3
Sep 29 12:44:07 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ddbc6e-7eef-4efd-bfd2-1d3ff33da30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-582332019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad994d98-3406-4966-97cc-63ce88aff9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37fa8258264451aabac588a473af652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:08Z,use_quota=True,user_id='53c037008be142c4b2ae74b2c91ebf8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4780a112-e3da-486c-9065-9136f50c5796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4780a112-e3da-486c-9065-9136f50c5796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02124fd-aadb-4795-92c9-d2b2bcd89245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02124fd-aadb-4795-92c9-d2b2bcd89245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad994d98-3406-4966-97cc-63ce88aff9ad', 'volume_name': 'volume-ad994d98-3406-4966-97cc-63ce88aff9ad', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d894f4d-77d4-4436-94b0-bc3e6aa65adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d894f4d-77d4-4436-94b0-bc3e6aa65adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d01f409-246a-4a7b-a6c4-1e21b4f7b284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:07 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Volume ad994d98-3406-4966-97cc-63ce88aff9ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad994d98-3406-4966-97cc-63ce88aff9ad', 'volume_size': 1}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:07 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:07 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:08 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3" returned: 0 in 0.399s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:08 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3 is being set with open permissions: ugo+rw
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:08 devstack sudo[106638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3
Sep 29 12:44:08 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:08 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.283s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:44:08 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:08 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.info
Sep 29 12:44:08 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:08 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.info" returned: 0 in 0.266s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:08 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.info is being set with open permissions: ugo+rw
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:08 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.info
Sep 29 12:44:08 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:08 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.info" returned: 0 in 0.253s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.388s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:08 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] Creating offline snapshot 966495fc-d873-4904-926f-f497544f60a3 of volume 4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:44:09 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2ae80bb3-a8f3-4402-8c6c-e419e7311659 tempest-ProjectReaderTests-871661053 None] Create snapshot completed successfully
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae4bdc7-b279-41ba-9c52-4a0c1a7291ce]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:09 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39
Sep 29 12:44:09 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:09 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39" returned: 0 in 0.415s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:09 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3 1G
Sep 29 12:44:09 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Lock "cinder-a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-f7a06559-4d24-4a61-8cd8-2a268eec8b89" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-f7a06559-4d24-4a61-8cd8-2a268eec8b89" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Deleting offline snapshot a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3 of volume f7a06559-4d24-4a61-8cd8-2a268eec8b89 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] snapshot_file for this snap is: volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c8f903-1712-4456-af7d-5250b60d7720]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:09 devstack sudo[106654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3
Sep 29 12:44:09 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:09 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3 1G" returned: 0 in 0.484s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:09 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:09 devstack sudo[106660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3
Sep 29 12:44:09 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:10 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3" returned: 0 in 0.433s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3c868c-660f-4ba1-90b6-8e447c23ea94]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:10 devstack sudo[106665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89
Sep 29 12:44:10 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:10 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3" returned: 0 in 0.357s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:10 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3 is being set with open permissions: ugo+rw
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:10 devstack sudo[106671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3
Sep 29 12:44:10 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Flow 'volume_create_manager' (d63a4ab2-cb7d-418d-8159-f63da1dede73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d9e3f6-00d1-4854-850f-9e32bbcbe16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:10 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89" returned: 0 in 0.417s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d9e3f6-00d1-4854-850f-9e32bbcbe16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-792380242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc03fe9f-2610-481b-892f-f3abfdbe2a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6103fe3a2e495a86f4d9be656ebba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:10Z,use_quota=True,user_id='4bc70c68367f4a7ab17a1144463ae743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:10 devstack sudo[106676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3
Sep 29 12:44:10 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fc6aab-566b-40bb-94bd-1f41d0c1862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fc6aab-566b-40bb-94bd-1f41d0c1862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee49a980-a9ed-4445-b84b-a3915356e173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee49a980-a9ed-4445-b84b-a3915356e173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc03fe9f-2610-481b-892f-f3abfdbe2a68', 'volume_name': 'volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbcc3d9-a898-4a1f-a658-357e53bb5ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbcc3d9-a898-4a1f-a658-357e53bb5ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a18deec-4f99-4766-a860-55b757b7ec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:10 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Volume fc03fe9f-2610-481b-892f-f3abfdbe2a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68', 'volume_size': 1}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:10 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3" returned: 0 in 0.327s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:10 devstack sudo[106679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.info
Sep 29 12:44:10 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:10 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:10 devstack sudo[106684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3
Sep 29 12:44:10 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:10 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.info" returned: 0 in 0.311s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:10 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.info is being set with open permissions: ugo+rw
Sep 29 12:44:10 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:10 devstack sudo[106687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.info
Sep 29 12:44:10 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:11 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89.a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3" returned: 0 in 0.261s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3" released by "_delete_snapshot" :: held 1.599s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-f7a06559-4d24-4a61-8cd8-2a268eec8b89" released by "delete_snapshot" :: held 1.633s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Created reservations ['77e5fa45-80bf-4b9a-b0fc-1312e394c12a', '1426802d-58c4-4741-8160-f0578fd488d2', 'bd9a0cc8-1ee0-4cb1-834e-e5438668d5ac', 'f0adc574-d8c1-404f-b700-5a0fcb4aa865'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:11 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.info" returned: 0 in 0.270s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.407s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-582332019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad994d98-3406-4966-97cc-63ce88aff9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37fa8258264451aabac588a473af652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:08Z,use_quota=True,user_id='53c037008be142c4b2ae74b2c91ebf8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Creating volume ad994d98-3406-4966-97cc-63ce88aff9ad {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:11 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:11 devstack sudo[106691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad 1073741824
Sep 29 12:44:11 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fb158e3b-ccd3-4846-a208-5c21710fd751 tempest-ProjectMemberTests-222694199 None] Create snapshot completed successfully
Sep 29 12:44:11 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Delete snapshot completed successfully.
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-ff7443e3-db78-47c8-9ed6-38c010d4a490 tempest-ProjectReaderTests-871661053 None] Lock "cinder-a6bcaba5-96e7-4c4e-a98c-56c267cdc4c3-delete_snapshot" released by "delete_snapshot" :: held 1.855s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-f7a06559-4d24-4a61-8cd8-2a268eec8b89-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Lock "cinder-f7a06559-4d24-4a61-8cd8-2a268eec8b89-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:11 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad 1073741824" returned: 0 in 0.475s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-f7a06559-4d24-4a61-8cd8-2a268eec8b89" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-f7a06559-4d24-4a61-8cd8-2a268eec8b89" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c46d73-bedc-443d-9336-b398bfc69b49]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:11 devstack sudo[106696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad
Sep 29 12:44:11 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:11 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89
Sep 29 12:44:11 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-966495fc-d873-4904-926f-f497544f60a3-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Lock "cinder-966495fc-d873-4904-926f-f497544f60a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:11 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-966495fc-d873-4904-926f-f497544f60a3" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-966495fc-d873-4904-926f-f497544f60a3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Deleting offline snapshot 966495fc-d873-4904-926f-f497544f60a3 of volume 4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] snapshot_file for this snap is: volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[904cfe54-6923-4f5e-a46c-a41803b1236e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:12 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad" returned: 0 in 0.292s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.565s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-792380242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc03fe9f-2610-481b-892f-f3abfdbe2a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6103fe3a2e495a86f4d9be656ebba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:10Z,use_quota=True,user_id='4bc70c68367f4a7ab17a1144463ae743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Creating volume fc03fe9f-2610-481b-892f-f3abfdbe2a68 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:12 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d01f409-246a-4a7b-a6c4-1e21b4f7b284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad994d98-3406-4966-97cc-63ce88aff9ad', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:12 devstack sudo[106702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68 1073741824
Sep 29 12:44:12 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59996401-388b-4a7e-b430-5113d2019e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:12 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Volume volume-ad994d98-3406-4966-97cc-63ce88aff9ad (ad994d98-3406-4966-97cc-63ce88aff9ad): created successfully
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59996401-388b-4a7e-b430-5113d2019e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:12 devstack sudo[106701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3
Sep 29 12:44:12 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Flow 'volume_create_manager' (179c0006-dad8-4e6b-9336-93b0cf84f6d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:12 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ef3aca68-f47c-44d5-bf28-2a1a9137bdc1 tempest-CinderUnicodeTest-1013839484 None] Created volume successfully.
Sep 29 12:44:12 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89" returned: 0 in 0.431s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:12 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89
Sep 29 12:44:12 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:12 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3" returned: 0 in 0.424s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5758d7be-4029-4e9a-a6ef-aa43c4bd3c3e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:12 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-f7a06559-4d24-4a61-8cd8-2a268eec8b89" returned: 0 in 0.324s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-f7a06559-4d24-4a61-8cd8-2a268eec8b89" released by "delete_volume" :: held 0.835s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:12 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68 1073741824" returned: 0 in 0.527s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Created reservations ['10374987-143a-4f7a-83ad-a844ee3dd61f', '33f34e91-7f15-4071-8459-cb13d310a5b6', 'e12e3db5-70e8-43e6-8ab6-c9b396129318', 'cc089305-0ccc-4599-9517-aff2609c80e9'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:12 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39
Sep 29 12:44:12 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:12 devstack sudo[106720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68
Sep 29 12:44:12 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:12 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:12 devstack sudo[106722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:12 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:13 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68" returned: 0 in 0.385s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a18deec-4f99-4766-a860-55b757b7ec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67caf813-8722-4013-b301-6fd049969684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:13 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Volume volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68 (fc03fe9f-2610-481b-892f-f3abfdbe2a68): created successfully
Sep 29 12:44:13 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67caf813-8722-4013-b301-6fd049969684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Flow 'volume_create_manager' (d63a4ab2-cb7d-418d-8159-f63da1dede73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.381s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:13 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Deleted volume successfully.
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39" returned: 0 in 0.647s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:13 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b04dd500-8a41-4cbb-beb2-a2b350f372ba tempest-ProjectReaderTests-261290735 None] Created volume successfully.
Sep 29 12:44:13 devstack sudo[106729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-66702320-ff06-40cb-a131-6756a87e44de tempest-ProjectReaderTests-871661053 None] Lock "cinder-f7a06559-4d24-4a61-8cd8-2a268eec8b89-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:13 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] Creating offline snapshot afce219e-f1af-42c0-bde5-ddc586eb96e9 of volume ad994d98-3406-4966-97cc-63ce88aff9ad {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3f9632-e3cc-41ff-9d18-24ef9cb8c487]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:13 devstack sudo[106731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad
Sep 29 12:44:13 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:13 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Flow 'volume_create_manager' (06ed117f-4384-4ecf-b595-b9468bd393ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdceee4-b442-43dd-92f5-4732d544828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3" returned: 0 in 0.571s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdceee4-b442-43dd-92f5-4732d544828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160874023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17edb71f-0482-47d2-ac3f-c1eb61ac3d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4b9d60c0554e6d852d22644f59710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:14Z,use_quota=True,user_id='ff292419227045368c3f611020093b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:13 devstack sudo[106737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3
Sep 29 12:44:13 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c694b931-afc1-4b6e-a715-f93933de95ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c694b931-afc1-4b6e-a715-f93933de95ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96a95fb-562d-4720-af17-065049c04638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96a95fb-562d-4720-af17-065049c04638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17edb71f-0482-47d2-ac3f-c1eb61ac3d26', 'volume_name': 'volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e8f994-73f0-4fa7-843c-6114cb8e8ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e8f994-73f0-4fa7-843c-6114cb8e8ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0cf27f-2f73-47a6-b5be-9c8f8bea826e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:13 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Volume 17edb71f-0482-47d2-ac3f-c1eb61ac3d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26', 'volume_size': 1}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Acquiring lock "cinder-fc03fe9f-2610-481b-892f-f3abfdbe2a68-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Lock "cinder-fc03fe9f-2610-481b-892f-f3abfdbe2a68-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:13 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad" returned: 0 in 0.519s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:13 devstack sudo[106741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9 1G
Sep 29 12:44:13 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Acquiring lock "cinder-quobyte-fc03fe9f-2610-481b-892f-f3abfdbe2a68" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Lock "cinder-quobyte-fc03fe9f-2610-481b-892f-f3abfdbe2a68" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0197a24e-c9b9-4538-9f04-9acdcf469932]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:13 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:14 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39.966495fc-d873-4904-926f-f497544f60a3" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-966495fc-d873-4904-926f-f497544f60a3" released by "_delete_snapshot" :: held 2.087s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:14 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68
Sep 29 12:44:14 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39" released by "delete_snapshot" :: held 2.120s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Created reservations ['f10ea742-fde1-4dab-a4a8-5297c4ebd133', '83bcde5e-6b54-40fa-8476-fda4bf9d62ae', '8afa3858-047c-4925-a95d-f24b0e8f81e3', '83295c60-07d9-4d01-8309-e63a04c295eb'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:14 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Delete snapshot completed successfully.
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-616d5822-cd57-445c-875c-2ab1f4818675 tempest-ProjectMemberTests-222694199 None] Lock "cinder-966495fc-d873-4904-926f-f497544f60a3-delete_snapshot" released by "delete_snapshot" :: held 2.296s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:14 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Lock "cinder-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9 1G" returned: 0 in 0.548s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:14 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad994d98-3406-4966-97cc-63ce88aff9ad -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68" returned: 0 in 0.468s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:14 devstack sudo[106753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad994d98-3406-4966-97cc-63ce88aff9ad -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9
Sep 29 12:44:14 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:14 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68
Sep 29 12:44:14 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd8b79c-6eb0-4eaf-abb6-e974afcfa650]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:14 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39
Sep 29 12:44:14 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:14 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-fc03fe9f-2610-481b-892f-f3abfdbe2a68" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Lock "cinder-quobyte-fc03fe9f-2610-481b-892f-f3abfdbe2a68" released by "delete_volume" :: held 0.793s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:14 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad994d98-3406-4966-97cc-63ce88aff9ad -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:14 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9 is being set with open permissions: ugo+rw
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:14 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9
Sep 29 12:44:14 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Created reservations ['9a4114d6-1dd2-4edb-8ee7-b239f08c7f53', 'ff71f3c4-b2bc-49ee-a8db-77084a53db2e', 'dca00871-789f-4525-b231-b9dd402e7f0d', 'da309151-1b22-42b4-91c8-06d822a32b3a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:14 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:14 devstack sudo[106768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:14 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:15 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39" returned: 0 in 0.460s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:15 devstack sudo[106771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39
Sep 29 12:44:15 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:15 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9" returned: 0 in 0.326s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:15 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.info
Sep 29 12:44:15 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:15 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.298s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Deleted volume successfully.
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5c590cd3-19d6-4091-b7ef-31e105d73cb7 tempest-ProjectReaderTests-261290735 None] Lock "cinder-fc03fe9f-2610-481b-892f-f3abfdbe2a68-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:15 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39" returned: 0 in 0.313s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39" released by "delete_volume" :: held 0.864s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:15 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Created reservations ['68ab7f18-9132-4a7a-b514-bd2537039b9e', 'e84d02f8-f314-42e0-be8b-26c31a6d4d94', '518fefa2-ab87-47cd-852b-c2636dc23d5a', '0e73d98e-194a-4065-855a-4f857527d254'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.info" returned: 0 in 0.330s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:15 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.info is being set with open permissions: ugo+rw
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:15 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.info
Sep 29 12:44:15 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:15 devstack sudo[106781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:15 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Flow 'volume_create_manager' (fbd1e27a-c70c-4d38-bdd9-08fedf4045fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0dc786-8655-4b1b-9fa2-7240c721bf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0dc786-8655-4b1b-9fa2-7240c721bf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142480960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c67527-34f2-496a-9c43-0dd904690b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6103fe3a2e495a86f4d9be656ebba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:16Z,use_quota=True,user_id='4bc70c68367f4a7ab17a1144463ae743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ed7e3f-c00d-4d58-9bd3-69b8c87bc5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ed7e3f-c00d-4d58-9bd3-69b8c87bc5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ac356b-1f80-4367-8bb5-103f37088359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ac356b-1f80-4367-8bb5-103f37088359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c67527-34f2-496a-9c43-0dd904690b82', 'volume_name': 'volume-b1c67527-34f2-496a-9c43-0dd904690b82', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99363ff-059d-4d03-982a-fb503ac54b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99363ff-059d-4d03-982a-fb503ac54b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafd7b55-7b01-4be4-8b87-edf3212118e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:15 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Volume b1c67527-34f2-496a-9c43-0dd904690b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c67527-34f2-496a-9c43-0dd904690b82', 'volume_size': 1}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:15 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.info" returned: 0 in 0.293s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.452s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.947s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160874023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17edb71f-0482-47d2-ac3f-c1eb61ac3d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4b9d60c0554e6d852d22644f59710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:14Z,use_quota=True,user_id='ff292419227045368c3f611020093b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Creating volume 17edb71f-0482-47d2-ac3f-c1eb61ac3d26 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:15 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:15 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26 1073741824
Sep 29 12:44:15 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-05495974-90a0-4ec3-8de7-959bb185a063 tempest-CinderUnicodeTest-1013839484 None] Create snapshot completed successfully
Sep 29 12:44:15 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.355s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:15 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:15 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Deleted volume successfully.
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-7fbbfc13-5bac-446d-ae0b-b4a2d79b0ca4 tempest-ProjectMemberTests-222694199 None] Lock "cinder-4cdaa2c8-af70-4987-a9e8-5ee00fdcdc39-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:16 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26 1073741824" returned: 0 in 0.500s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:16 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26
Sep 29 12:44:16 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (d84143b8-1be7-4552-8387-7123ddcc07a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35be5934-341d-4d86-bf93-4454f5d0860f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35be5934-341d-4d86-bf93-4454f5d0860f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980329640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:16Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e5927a-5198-4df4-a426-b1f923260425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e5927a-5198-4df4-a426-b1f923260425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50ac7e4-cce1-4da1-b8b4-a822b8629b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50ac7e4-cce1-4da1-b8b4-a822b8629b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9', 'volume_name': 'volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a943fac-54a7-4fa7-bcd6-fbc4e780e3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a943fac-54a7-4fa7-bcd6-fbc4e780e3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39ad6a7-1e36-4721-99ce-cf3c41ab9034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:16 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Volume dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9', 'volume_size': 1}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "cinder-afce219e-f1af-42c0-bde5-ddc586eb96e9-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-afce219e-f1af-42c0-bde5-ddc586eb96e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "cinder-quobyte-ad994d98-3406-4966-97cc-63ce88aff9ad" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-quobyte-ad994d98-3406-4966-97cc-63ce88aff9ad" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "cinder-quobyte-afce219e-f1af-42c0-bde5-ddc586eb96e9" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-quobyte-afce219e-f1af-42c0-bde5-ddc586eb96e9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Deleting offline snapshot afce219e-f1af-42c0-bde5-ddc586eb96e9 of volume ad994d98-3406-4966-97cc-63ce88aff9ad {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] snapshot_file for this snap is: volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:44:16 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26" returned: 0 in 0.292s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142480960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c67527-34f2-496a-9c43-0dd904690b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6103fe3a2e495a86f4d9be656ebba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:16Z,use_quota=True,user_id='4bc70c68367f4a7ab17a1144463ae743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Creating volume b1c67527-34f2-496a-9c43-0dd904690b82 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:16 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b1c67527-34f2-496a-9c43-0dd904690b82 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[66647b39-994d-40f9-b027-146ae34f0a11]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:16 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b1c67527-34f2-496a-9c43-0dd904690b82 1073741824
Sep 29 12:44:16 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0cf27f-2f73-47a6-b5be-9c8f8bea826e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cc1e3d-1753-477e-8e64-8ea7b2969574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:16 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Volume volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26 (17edb71f-0482-47d2-ac3f-c1eb61ac3d26): created successfully
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cc1e3d-1753-477e-8e64-8ea7b2969574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:16 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Flow 'volume_create_manager' (06ed117f-4384-4ecf-b595-b9468bd393ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:16 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-24592a42-2bf7-4561-a4fd-6b3cc6f26e0d tempest-ProjectReaderTests-871661053 None] Created volume successfully.
Sep 29 12:44:16 devstack sudo[106795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9
Sep 29 12:44:16 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:17 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9" returned: 0 in 0.405s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad994d98-3406-4966-97cc-63ce88aff9ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92fad07-81f5-4f6a-8b3b-2deb66068220]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:17 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b1c67527-34f2-496a-9c43-0dd904690b82 1073741824" returned: 0 in 0.564s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:17 devstack sudo[106806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad
Sep 29 12:44:17 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b1c67527-34f2-496a-9c43-0dd904690b82 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:17 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b1c67527-34f2-496a-9c43-0dd904690b82
Sep 29 12:44:17 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:17 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad" returned: 0 in 0.381s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:17 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b1c67527-34f2-496a-9c43-0dd904690b82" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.047s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980329640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:16Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Creating volume dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:17 devstack sudo[106814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9
Sep 29 12:44:17 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:17 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafd7b55-7b01-4be4-8b87-edf3212118e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c67527-34f2-496a-9c43-0dd904690b82', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:17 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 1073741824
Sep 29 12:44:17 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae58992-84e1-424e-9050-5f67be205768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:17 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Volume volume-b1c67527-34f2-496a-9c43-0dd904690b82 (b1c67527-34f2-496a-9c43-0dd904690b82): created successfully
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae58992-84e1-424e-9050-5f67be205768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Flow 'volume_create_manager' (fbd1e27a-c70c-4d38-bdd9-08fedf4045fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:17 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-d40f6e8f-05f6-47b6-98e7-228b61a08d33 tempest-ProjectReaderTests-261290735 None] Created volume successfully.
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Acquiring lock "cinder-b1c67527-34f2-496a-9c43-0dd904690b82-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Lock "cinder-b1c67527-34f2-496a-9c43-0dd904690b82-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Acquiring lock "cinder-quobyte-b1c67527-34f2-496a-9c43-0dd904690b82" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Lock "cinder-quobyte-b1c67527-34f2-496a-9c43-0dd904690b82" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44a1728-b37e-4e7b-a515-e29ce68b0295]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b1c67527-34f2-496a-9c43-0dd904690b82 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:17 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9" returned: 0 in 0.445s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:17 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:17 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9
Sep 29 12:44:17 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:17 devstack sudo[106826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b1c67527-34f2-496a-9c43-0dd904690b82
Sep 29 12:44:17 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:18 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 1073741824" returned: 0 in 0.540s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:18 devstack sudo[106831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9
Sep 29 12:44:18 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:18 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad.afce219e-f1af-42c0-bde5-ddc586eb96e9" returned: 0 in 0.279s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-quobyte-afce219e-f1af-42c0-bde5-ddc586eb96e9" released by "_delete_snapshot" :: held 1.687s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-quobyte-ad994d98-3406-4966-97cc-63ce88aff9ad" released by "delete_snapshot" :: held 1.711s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:18 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b1c67527-34f2-496a-9c43-0dd904690b82" returned: 0 in 0.427s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b1c67527-34f2-496a-9c43-0dd904690b82 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:18 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b1c67527-34f2-496a-9c43-0dd904690b82
Sep 29 12:44:18 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Created reservations ['fbba13f8-a2fc-4b4d-b259-9b8db8623caf', 'db3cee5a-4446-43ed-a495-2d3e1a16f871', 'c4dca52e-8710-4099-a4e6-067fc7469525', '117b97da-3e8c-49d0-9dd1-1b779be0fb7f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:18 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9" returned: 0 in 0.301s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.262s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39ad6a7-1e36-4721-99ce-cf3c41ab9034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773518ec-46c2-4567-ae62-6c25cad9f7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] Creating offline snapshot 6750b92a-fb3c-4651-b1d0-de4a73c75bbc of volume 17edb71f-0482-47d2-ac3f-c1eb61ac3d26 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:44:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Volume volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 (dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9): created successfully
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773518ec-46c2-4567-ae62-6c25cad9f7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (d84143b8-1be7-4552-8387-7123ddcc07a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[16392429-c7b3-44ee-bd19-8fc3c05c0024]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-91d5bc25-1388-4020-894b-73d23c4f6d81 tempest-ProjectMemberTests-222694199 None] Created volume successfully.
Sep 29 12:44:18 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Delete snapshot completed successfully.
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-19fda182-0ff8-42e3-9e37-2a08d352739a tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-afce219e-f1af-42c0-bde5-ddc586eb96e9-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:18 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-b1c67527-34f2-496a-9c43-0dd904690b82" returned: 0 in 0.296s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:18 devstack sudo[106840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26
Sep 29 12:44:18 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Lock "cinder-quobyte-b1c67527-34f2-496a-9c43-0dd904690b82" released by "delete_volume" :: held 0.765s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Created reservations ['c4978f4d-c6ba-4f1b-8375-084f887937a9', '3eb393fa-2d51-4d5c-ad43-e434606ce08e', '7db95622-ca34-47ec-a8e6-66e047c7f3d7', 'e12b2302-01ae-4bf0-93b9-7e593a8bbd47'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "cinder-ad994d98-3406-4966-97cc-63ce88aff9ad-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:18 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-ad994d98-3406-4966-97cc-63ce88aff9ad-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:18 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "cinder-quobyte-ad994d98-3406-4966-97cc-63ce88aff9ad" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-quobyte-ad994d98-3406-4966-97cc-63ce88aff9ad" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:18 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26" returned: 0 in 0.430s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[62edef3a-52d5-4346-9b1c-aea1f0e6a6e1]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:18 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc 1G
Sep 29 12:44:18 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:19 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.302s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:19 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad
Sep 29 12:44:19 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:19 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Deleted volume successfully.
Sep 29 12:44:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-f9095815-c07f-4113-af37-dbdc7720cbbb tempest-ProjectReaderTests-261290735 None] Lock "cinder-b1c67527-34f2-496a-9c43-0dd904690b82-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:19 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad" returned: 0 in 0.462s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:19 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc 1G" returned: 0 in 0.505s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:19 devstack sudo[106859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad
Sep 29 12:44:19 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:19 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc
Sep 29 12:44:19 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:19 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad994d98-3406-4966-97cc-63ce88aff9ad" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:19 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-quobyte-ad994d98-3406-4966-97cc-63ce88aff9ad" released by "delete_volume" :: held 0.868s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:19 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc" returned: 0 in 0.383s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:19 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc is being set with open permissions: ugo+rw
Sep 29 12:44:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:19 devstack sudo[106867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc
Sep 29 12:44:19 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:19 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Created reservations ['75b51e48-1c12-4e90-b67c-02b49168152d', 'f851313e-0d6d-4ec2-b2df-e59c1fe2db4a', 'e810944e-4e93-456e-9fb5-3d4795243905', 'e6ca01bb-4831-46ce-be71-4e21e062a383'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:20 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc" returned: 0 in 0.334s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:20 devstack sudo[106870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:20 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:20 devstack sudo[106872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.info
Sep 29 12:44:20 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:20 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.262s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Deleted volume successfully.
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-35be17e0-fc4b-47b6-94a3-b509c7bbe98f tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-ad994d98-3406-4966-97cc-63ce88aff9ad-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:20 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.info" returned: 0 in 0.291s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:20 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.info is being set with open permissions: ugo+rw
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:20 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.info
Sep 29 12:44:20 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:20 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.info" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.719s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] Creating offline snapshot 37caf3b3-bc7d-4566-9a46-fb8134a44011 of volume dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:44:20 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-841b7791-9799-4a5e-a48e-ec1473e5f3e4 tempest-ProjectReaderTests-871661053 None] Create snapshot completed successfully
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f741a1bc-a9d9-46dd-8126-d9f126530446]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:20 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:20 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9
Sep 29 12:44:20 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "cinder-0e265222-e8a6-4c83-a01f-cb617a898753-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-0e265222-e8a6-4c83-a01f-cb617a898753-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "cinder-quobyte-0e265222-e8a6-4c83-a01f-cb617a898753" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-quobyte-0e265222-e8a6-4c83-a01f-cb617a898753" acquired by "delete_volume" :: waited 0.024s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5784a73f-4798-4d8f-8b5d-5bdeb1b71b25]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0e265222-e8a6-4c83-a01f-cb617a898753 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:21 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9" returned: 0 in 0.453s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:21 devstack sudo[106885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011 1G
Sep 29 12:44:21 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:21 devstack sudo[106884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0e265222-e8a6-4c83-a01f-cb617a898753
Sep 29 12:44:21 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-6750b92a-fb3c-4651-b1d0-de4a73c75bbc-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Lock "cinder-6750b92a-fb3c-4651-b1d0-de4a73c75bbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-17edb71f-0482-47d2-ac3f-c1eb61ac3d26" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-17edb71f-0482-47d2-ac3f-c1eb61ac3d26" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-6750b92a-fb3c-4651-b1d0-de4a73c75bbc" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-6750b92a-fb3c-4651-b1d0-de4a73c75bbc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Deleting offline snapshot 6750b92a-fb3c-4651-b1d0-de4a73c75bbc of volume 17edb71f-0482-47d2-ac3f-c1eb61ac3d26 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] snapshot_file for this snap is: volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc13a10-8038-4336-ba8c-a77d91d78946]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:21 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0e265222-e8a6-4c83-a01f-cb617a898753" returned: 0 in 0.474s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0e265222-e8a6-4c83-a01f-cb617a898753 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:21 devstack sudo[106888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc
Sep 29 12:44:21 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:21 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0e265222-e8a6-4c83-a01f-cb617a898753
Sep 29 12:44:21 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:21 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011 1G" returned: 0 in 0.596s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:21 devstack sudo[106899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011
Sep 29 12:44:21 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:21 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0e265222-e8a6-4c83-a01f-cb617a898753" returned: 0 in 0.307s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-quobyte-0e265222-e8a6-4c83-a01f-cb617a898753" released by "delete_volume" :: held 0.839s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:22 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc" returned: 0 in 0.484s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[19529b53-306f-41e7-837b-1393222fa98d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Created reservations ['e419520f-7ccf-4915-b5e4-d947ac06b080', '8622abc4-3357-4e9c-8998-cf83d77b590a', '1449896a-018e-4b51-b29b-085e1397cf6b', '576f4482-ffe4-4333-ac5b-45a9b50e012c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:22 devstack sudo[106906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26
Sep 29 12:44:22 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:22 devstack sudo[106910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:22 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:22 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011" returned: 0 in 0.404s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:22 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011 is being set with open permissions: ugo+rw
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:22 devstack sudo[106913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011
Sep 29 12:44:22 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:22 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26" returned: 0 in 0.539s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:22 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:22 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.412s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011" returned: 0 in 0.366s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:22 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Deleted volume successfully.
Sep 29 12:44:22 devstack sudo[106920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc
Sep 29 12:44:22 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:22 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22ed671e-0c65-48f7-a7f7-7c6c5ca5a659 tempest-CinderUnicodeTest-1013839484 None] Lock "cinder-0e265222-e8a6-4c83-a01f-cb617a898753-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:22 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.info
Sep 29 12:44:22 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:23 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.info" returned: 0 in 0.329s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:23 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.info is being set with open permissions: ugo+rw
Sep 29 12:44:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:23 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.info
Sep 29 12:44:23 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:23 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc" returned: 0 in 0.489s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:23 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc
Sep 29 12:44:23 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:23 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.info" returned: 0 in 0.347s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.622s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-4bed3372-2f71-467d-9fec-61a9e83f5bbb tempest-ProjectMemberTests-222694199 None] Create snapshot completed successfully
Sep 29 12:44:23 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26.6750b92a-fb3c-4651-b1d0-de4a73c75bbc" returned: 0 in 0.362s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-6750b92a-fb3c-4651-b1d0-de4a73c75bbc" released by "_delete_snapshot" :: held 2.004s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-17edb71f-0482-47d2-ac3f-c1eb61ac3d26" released by "delete_snapshot" :: held 2.039s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:23 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Created reservations ['a4e0c65a-8fe8-4f53-ad72-b35b77b1de47', '8c0edc3d-6ce2-4628-b2a1-116904f0c8ec', 'af629c79-2bdd-4a35-9b20-37290cba3718', 'a2599fc2-eee5-4756-a1dc-1b3637f2cf68'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Delete snapshot completed successfully.
Sep 29 12:44:23 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-530b7093-a086-490c-8b27-32173e482108 tempest-ProjectReaderTests-871661053 None] Lock "cinder-6750b92a-fb3c-4651-b1d0-de4a73c75bbc-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-37caf3b3-bc7d-4566-9a46-fb8134a44011-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Lock "cinder-37caf3b3-bc7d-4566-9a46-fb8134a44011-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-37caf3b3-bc7d-4566-9a46-fb8134a44011" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-37caf3b3-bc7d-4566-9a46-fb8134a44011" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Deleting offline snapshot 37caf3b3-bc7d-4566-9a46-fb8134a44011 of volume dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] snapshot_file for this snap is: volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15b5ad0-a726-4879-a249-9ebc4372f75e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:24 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011
Sep 29 12:44:24 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-17edb71f-0482-47d2-ac3f-c1eb61ac3d26-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Lock "cinder-17edb71f-0482-47d2-ac3f-c1eb61ac3d26-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:24 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-17edb71f-0482-47d2-ac3f-c1eb61ac3d26" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011" returned: 0 in 0.533s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-17edb71f-0482-47d2-ac3f-c1eb61ac3d26" acquired by "delete_volume" :: waited 0.066s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22f15e2-d812-4d96-b39a-fc1c8f5e9b09]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fa4c6e-f729-48f8-bef8-1b91bbb1b427]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:25 devstack sudo[106942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26
Sep 29 12:44:25 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:25 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9
Sep 29 12:44:25 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:25 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9" returned: 0 in 0.450s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:25 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26" returned: 0 in 0.452s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:25 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011
Sep 29 12:44:25 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:25 devstack sudo[106952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26
Sep 29 12:44:25 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:25 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-17edb71f-0482-47d2-ac3f-c1eb61ac3d26" returned: 0 in 0.321s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-17edb71f-0482-47d2-ac3f-c1eb61ac3d26" released by "delete_volume" :: held 0.880s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:25 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Created reservations ['0ec7c2c0-8376-4269-8319-8a9f654f3bf7', '01a4a4eb-5b30-4da7-81f1-060e8ddf3edb', '6b409d41-a76a-46db-85d6-707c6c8e7182', '5a619bc6-fb68-4159-9c55-fc6aee0a23b1'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:25 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011" returned: 0 in 0.447s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:25 devstack sudo[106960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011
Sep 29 12:44:25 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:26 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:26 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:26 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9.37caf3b3-bc7d-4566-9a46-fb8134a44011" returned: 0 in 0.346s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-37caf3b3-bc7d-4566-9a46-fb8134a44011" released by "_delete_snapshot" :: held 1.992s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9" released by "delete_snapshot" :: held 2.023s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Created reservations ['46323c96-2ac9-4201-8ee1-2ae87ce93920', '29bf0ffc-aee3-44ae-8ef6-62d2437f1411', '851e222e-3dbf-48ed-a884-2fd938b4e65d', 'e56b3e93-80c2-418d-a796-c5467f5defdf'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:26 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.318s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Deleted volume successfully.
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-22b86977-d007-403d-9047-986f92ee912c tempest-ProjectReaderTests-871661053 None] Lock "cinder-17edb71f-0482-47d2-ac3f-c1eb61ac3d26-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:26 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Delete snapshot completed successfully.
Sep 29 12:44:26 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-2696ef51-2b24-416c-8e57-1d2777e9eba5 tempest-ProjectMemberTests-222694199 None] Lock "cinder-37caf3b3-bc7d-4566-9a46-fb8134a44011-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Lock "cinder-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[82270ee6-7237-4d89-acd7-408e831ae075]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Flow 'volume_create_manager' (3a72f4a6-274f-4ab6-a034-1244f839206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d43a437-6cc5-4bdc-9524-a224a0eaba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d43a437-6cc5-4bdc-9524-a224a0eaba11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264850595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03175229-6296-4afa-9056-c5a067a9560d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4b9d60c0554e6d852d22644f59710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:28Z,use_quota=True,user_id='ff292419227045368c3f611020093b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad148d1-4e79-467f-9882-17dabcf60686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad148d1-4e79-467f-9882-17dabcf60686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d9d964-a4e4-4790-bc22-c2a3f4389bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d9d964-a4e4-4790-bc22-c2a3f4389bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03175229-6296-4afa-9056-c5a067a9560d', 'volume_name': 'volume-03175229-6296-4afa-9056-c5a067a9560d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d960aef-a55e-4160-a519-baf9dd14be92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:27 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9
Sep 29 12:44:27 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d960aef-a55e-4160-a519-baf9dd14be92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeff35fe-2e1f-4948-a122-51ebbc92a6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:27 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Volume 03175229-6296-4afa-9056-c5a067a9560d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03175229-6296-4afa-9056-c5a067a9560d', 'volume_size': 1}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264850595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03175229-6296-4afa-9056-c5a067a9560d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4b9d60c0554e6d852d22644f59710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:28Z,use_quota=True,user_id='ff292419227045368c3f611020093b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Creating volume 03175229-6296-4afa-9056-c5a067a9560d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:27 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:27 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:27 devstack sudo[106968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d 1073741824
Sep 29 12:44:27 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:28 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9" returned: 0 in 0.436s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:28 devstack sudo[106976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9
Sep 29 12:44:28 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:28 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d 1073741824" returned: 0 in 0.525s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:28 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9" returned: 0 in 0.293s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:28 devstack sudo[106979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d
Sep 29 12:44:28 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9" released by "delete_volume" :: held 0.833s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Created reservations ['7951beb7-794d-4001-8a38-bd67a14d83bd', '8f256ee5-8ada-466d-98e3-c8a455d9515a', '36de3260-a718-4816-8d5f-0f48d93ea593', 'ac868e16-74f8-48cc-bbe3-227beeb97c7e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:28 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:28 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:28 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d" returned: 0 in 0.328s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeff35fe-2e1f-4948-a122-51ebbc92a6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03175229-6296-4afa-9056-c5a067a9560d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be93ddb-4228-409c-935b-9db9c373c6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:28 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Volume volume-03175229-6296-4afa-9056-c5a067a9560d (03175229-6296-4afa-9056-c5a067a9560d): created successfully
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be93ddb-4228-409c-935b-9db9c373c6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Flow 'volume_create_manager' (3a72f4a6-274f-4ab6-a034-1244f839206a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-8973f1e9-3315-45f3-94c4-4ae73d584ef4 tempest-ProjectReaderTests-871661053 None] Created volume successfully.
Sep 29 12:44:28 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.356s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:28 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Deleted volume successfully.
Sep 29 12:44:28 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-54958b67-869e-4160-91f1-6e3decb55dba tempest-ProjectMemberTests-222694199 None] Lock "cinder-dc0f4ac0-a3e0-4c51-91d6-c0c28b7b8bc9-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (6dbd4697-b6f4-484a-b6e3-e80a9589c901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f29e85-4310-47b8-9e31-bf6e1fa3fbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f29e85-4310-47b8-9e31-bf6e1fa3fbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258774907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33542fc2-b00b-4567-906c-044ea30fa216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:29Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519b005d-1d28-4e46-adc4-3af03ff0dcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519b005d-1d28-4e46-adc4-3af03ff0dcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50e5923-d419-4534-8677-56d482cfcb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50e5923-d419-4534-8677-56d482cfcb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33542fc2-b00b-4567-906c-044ea30fa216', 'volume_name': 'volume-33542fc2-b00b-4567-906c-044ea30fa216', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42283063-7d2c-4ad2-9afa-b1a0f38fcb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42283063-7d2c-4ad2-9afa-b1a0f38fcb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b036d56-4192-4040-955a-3aa2ae331d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:29 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Volume 33542fc2-b00b-4567-906c-044ea30fa216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33542fc2-b00b-4567-906c-044ea30fa216', 'volume_size': 1}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258774907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33542fc2-b00b-4567-906c-044ea30fa216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:29Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Creating volume 33542fc2-b00b-4567-906c-044ea30fa216 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:29 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:29 devstack sudo[106985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216 1073741824
Sep 29 12:44:29 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:29 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216 1073741824" returned: 0 in 0.404s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:29 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:29 devstack sudo[106991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216
Sep 29 12:44:29 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:30 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b036d56-4192-4040-955a-3aa2ae331d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33542fc2-b00b-4567-906c-044ea30fa216', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1b4a8b-d4b0-4123-9e42-8d1dda3c8403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] Creating offline snapshot 3fe161ab-f204-4409-9ae5-199d64843b0b of volume 03175229-6296-4afa-9056-c5a067a9560d {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:44:30 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Volume volume-33542fc2-b00b-4567-906c-044ea30fa216 (33542fc2-b00b-4567-906c-044ea30fa216): created successfully
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1b4a8b-d4b0-4123-9e42-8d1dda3c8403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (6dbd4697-b6f4-484a-b6e3-e80a9589c901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44913e7-9daf-4a75-bea1-39b49a7b0b28]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:30 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fc8871bf-6366-4688-9870-4b4be612678c tempest-ProjectMemberTests-222694199 None] Created volume successfully.
Sep 29 12:44:30 devstack sudo[106994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d
Sep 29 12:44:30 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:30 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d" returned: 0 in 0.445s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:30 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:30 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b 1G
Sep 29 12:44:30 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:31 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b 1G" returned: 0 in 0.421s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03175229-6296-4afa-9056-c5a067a9560d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:31 devstack sudo[107004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03175229-6296-4afa-9056-c5a067a9560d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b
Sep 29 12:44:31 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:31 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03175229-6296-4afa-9056-c5a067a9560d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b" returned: 0 in 0.288s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:31 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b is being set with open permissions: ugo+rw
Sep 29 12:44:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:31 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b
Sep 29 12:44:31 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:31 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b" returned: 0 in 0.236s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:31 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.info
Sep 29 12:44:31 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:31 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.info" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:31 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.info is being set with open permissions: ugo+rw
Sep 29 12:44:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:31 devstack sudo[107015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.info
Sep 29 12:44:31 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:32 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.info" returned: 0 in 0.252s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.024s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.651s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] Creating offline snapshot 1568e4be-baa3-4fd4-b1ca-5829db21bd2b of volume 33542fc2-b00b-4567-906c-044ea30fa216 {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:44:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-6e20e631-2a72-4ef1-9a6e-03b8071f964e tempest-ProjectReaderTests-871661053 None] Create snapshot completed successfully
Sep 29 12:44:32 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc4d96c-51ea-4bca-b0ed-cda2a1e72410]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:32 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216
Sep 29 12:44:32 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:32 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216" returned: 0 in 0.395s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:32 devstack sudo[107023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b 1G
Sep 29 12:44:32 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:33 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b 1G" returned: 0 in 0.457s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33542fc2-b00b-4567-906c-044ea30fa216 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:33 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33542fc2-b00b-4567-906c-044ea30fa216 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b
Sep 29 12:44:33 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-3fe161ab-f204-4409-9ae5-199d64843b0b-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Lock "cinder-3fe161ab-f204-4409-9ae5-199d64843b0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-03175229-6296-4afa-9056-c5a067a9560d" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-03175229-6296-4afa-9056-c5a067a9560d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-3fe161ab-f204-4409-9ae5-199d64843b0b" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-3fe161ab-f204-4409-9ae5-199d64843b0b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Deleting offline snapshot 3fe161ab-f204-4409-9ae5-199d64843b0b of volume 03175229-6296-4afa-9056-c5a067a9560d {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] snapshot_file for this snap is: volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e8e58e-024f-4142-a2aa-09fb0383770a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:33 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33542fc2-b00b-4567-906c-044ea30fa216 -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b" returned: 0 in 0.383s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:33 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b is being set with open permissions: ugo+rw
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:33 devstack sudo[107034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b
Sep 29 12:44:33 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:33 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b
Sep 29 12:44:33 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:33 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b" returned: 0 in 0.303s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:33 devstack sudo[107039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.info
Sep 29 12:44:33 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:33 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b" returned: 0 in 0.472s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03175229-6296-4afa-9056-c5a067a9560d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[af32a416-0d3a-4bd1-beb2-bba1f99ad955]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:34 devstack sudo[107044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d
Sep 29 12:44:34 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:34 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.info" returned: 0 in 0.297s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:34 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.info is being set with open permissions: ugo+rw
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:34 devstack sudo[107047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.info
Sep 29 12:44:34 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:34 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.info" returned: 0 in 0.271s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:34 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d" returned: 0 in 0.448s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:34 devstack sudo[107053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b
Sep 29 12:44:34 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-032db8ac-3cd0-4e53-8364-33778d47d6e4 tempest-ProjectMemberTests-222694199 None] Create snapshot completed successfully
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-1568e4be-baa3-4fd4-b1ca-5829db21bd2b-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Lock "cinder-1568e4be-baa3-4fd4-b1ca-5829db21bd2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-33542fc2-b00b-4567-906c-044ea30fa216" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-33542fc2-b00b-4567-906c-044ea30fa216" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-1568e4be-baa3-4fd4-b1ca-5829db21bd2b" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-1568e4be-baa3-4fd4-b1ca-5829db21bd2b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:34 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Deleting offline snapshot 1568e4be-baa3-4fd4-b1ca-5829db21bd2b of volume 33542fc2-b00b-4567-906c-044ea30fa216 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] snapshot_file for this snap is: volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b" returned: 0 in 0.444s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7467f04-0411-445e-8ade-e0d3b6cfa9b1]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:34 devstack sudo[107060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b
Sep 29 12:44:34 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:34 devstack sudo[107061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b
Sep 29 12:44:34 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:35 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d.3fe161ab-f204-4409-9ae5-199d64843b0b" returned: 0 in 0.292s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-3fe161ab-f204-4409-9ae5-199d64843b0b" released by "_delete_snapshot" :: held 1.812s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-03175229-6296-4afa-9056-c5a067a9560d" released by "delete_snapshot" :: held 1.846s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Created reservations ['bf3777db-3aba-4cd7-83a7-6c90b3f37ba3', '5b889add-35e2-42e0-9648-d0198273f2ff', '0b9dc5f0-ef7d-4c3d-8602-65929257c4de', '36b1df78-2c6d-42af-9794-fb910d1be4d7'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:35 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b" returned: 0 in 0.464s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33542fc2-b00b-4567-906c-044ea30fa216(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fb7b01-a12b-4d70-873c-bee428114099]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Delete snapshot completed successfully.
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-242167d2-83bd-476a-9594-2163cf49b32d tempest-ProjectReaderTests-871661053 None] Lock "cinder-3fe161ab-f204-4409-9ae5-199d64843b0b-delete_snapshot" released by "delete_snapshot" :: held 2.084s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-03175229-6296-4afa-9056-c5a067a9560d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Lock "cinder-03175229-6296-4afa-9056-c5a067a9560d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:35 devstack sudo[107068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216
Sep 29 12:44:35 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-03175229-6296-4afa-9056-c5a067a9560d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-03175229-6296-4afa-9056-c5a067a9560d" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[520434f3-9152-4879-a8a4-c0430a2d2e79]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:35 devstack sudo[107070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d
Sep 29 12:44:35 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:35 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216" returned: 0 in 0.481s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:35 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b
Sep 29 12:44:35 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:36 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d" returned: 0 in 0.447s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:36 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d
Sep 29 12:44:36 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:36 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b" returned: 0 in 0.411s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:36 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b
Sep 29 12:44:36 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:36 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03175229-6296-4afa-9056-c5a067a9560d" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-03175229-6296-4afa-9056-c5a067a9560d" released by "delete_volume" :: held 0.793s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Created reservations ['b7fe3417-7fd5-4852-873f-786580e02815', '3c6bc691-84a5-4f01-9bf9-d67bf22e1eca', '4ebc3ba1-e367-4813-8972-be92eac7f0b0', 'fe895314-ea9a-4bbb-ad75-6714f6c60a05'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:36 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:36 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216.1568e4be-baa3-4fd4-b1ca-5829db21bd2b" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:36 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-1568e4be-baa3-4fd4-b1ca-5829db21bd2b" released by "_delete_snapshot" :: held 1.783s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-33542fc2-b00b-4567-906c-044ea30fa216" released by "delete_snapshot" :: held 1.819s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Created reservations ['22486a34-c513-4b1c-b5c3-c376c4bf5127', '700ee523-ef6f-47ca-bfd0-048f220e689d', '8ddf3f55-05ea-41be-a75c-63d5dcf60374', 'fa1ee21e-8508-4dc0-b6e3-3bc42d16902a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Delete snapshot completed successfully.
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-59b6169f-5cc7-4b1b-becc-2423ccd1d603 tempest-ProjectMemberTests-222694199 None] Lock "cinder-1568e4be-baa3-4fd4-b1ca-5829db21bd2b-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:36 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.341s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Deleted volume successfully.
Sep 29 12:44:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-97c6a219-3f17-43f8-b37b-f035382dc1f3 tempest-ProjectReaderTests-871661053 None] Lock "cinder-03175229-6296-4afa-9056-c5a067a9560d-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-33542fc2-b00b-4567-906c-044ea30fa216-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Lock "cinder-33542fc2-b00b-4567-906c-044ea30fa216-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-33542fc2-b00b-4567-906c-044ea30fa216" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-33542fc2-b00b-4567-906c-044ea30fa216" acquired by "delete_volume" :: waited 0.021s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c457e6-f7f4-4070-8890-0f129139bdab]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Flow 'volume_create_manager' (3c21ce6b-09e3-493b-afdb-4afdbf70783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e397d7-9820-41f6-adcc-92b354eff0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e397d7-9820-41f6-adcc-92b354eff0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-79406589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753c781f-f3f5-4cee-ab93-7d63a613315d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4b9d60c0554e6d852d22644f59710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:37Z,use_quota=True,user_id='ff292419227045368c3f611020093b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a42752-3543-469e-a550-9e9f966ef2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a42752-3543-469e-a550-9e9f966ef2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2779680e-9ace-49a7-84a5-858dfd4ce57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:37 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216
Sep 29 12:44:37 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2779680e-9ace-49a7-84a5-858dfd4ce57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753c781f-f3f5-4cee-ab93-7d63a613315d', 'volume_name': 'volume-753c781f-f3f5-4cee-ab93-7d63a613315d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435a6ab9-50e4-43f4-8c2a-10c1063503b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435a6ab9-50e4-43f4-8c2a-10c1063503b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86969034-8eda-4b2b-9827-8c140d239aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:37 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Volume 753c781f-f3f5-4cee-ab93-7d63a613315d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753c781f-f3f5-4cee-ab93-7d63a613315d', 'volume_size': 1}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-79406589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753c781f-f3f5-4cee-ab93-7d63a613315d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4b9d60c0554e6d852d22644f59710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:37Z,use_quota=True,user_id='ff292419227045368c3f611020093b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Creating volume 753c781f-f3f5-4cee-ab93-7d63a613315d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:37 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:37 devstack sudo[107094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d 1073741824
Sep 29 12:44:37 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:37 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216" returned: 0 in 0.409s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:37 devstack sudo[107101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216
Sep 29 12:44:37 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:37 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d 1073741824" returned: 0 in 0.513s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:37 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-33542fc2-b00b-4567-906c-044ea30fa216" returned: 0 in 0.340s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:37 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d
Sep 29 12:44:37 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-33542fc2-b00b-4567-906c-044ea30fa216" released by "delete_volume" :: held 0.834s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Created reservations ['a86594cb-18ed-4a5c-a4fd-2e96cc1fa2fe', '76db8bab-06ad-47e5-86fe-10f49fd12da6', '53448e27-fec1-4a0e-b6ce-9f81f82cccb3', '18205128-d6ff-469f-b9ec-839ff054f3ea'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:38 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:38 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:38 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d" returned: 0 in 0.428s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86969034-8eda-4b2b-9827-8c140d239aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753c781f-f3f5-4cee-ab93-7d63a613315d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6219b5-3849-4b7c-92da-41c10c2dce77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:38 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Volume volume-753c781f-f3f5-4cee-ab93-7d63a613315d (753c781f-f3f5-4cee-ab93-7d63a613315d): created successfully
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6219b5-3849-4b7c-92da-41c10c2dce77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Flow 'volume_create_manager' (3c21ce6b-09e3-493b-afdb-4afdbf70783d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a04656b5-36c6-4ef6-966c-134814e10022 tempest-ProjectReaderTests-871661053 None] Created volume successfully.
Sep 29 12:44:38 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.338s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Deleted volume successfully.
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-3383a3d4-aa93-459d-a331-fc81d554e516 tempest-ProjectMemberTests-222694199 None] Lock "cinder-33542fc2-b00b-4567-906c-044ea30fa216-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (8c379191-4fe2-46c9-9b68-26191cd80629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cd6259-6b5f-4a56-ae24-bce523f4dc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cd6259-6b5f-4a56-ae24-bce523f4dc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-648274751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bccd0db-cea1-4151-a9d7-6b068c7675fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:39Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb3a15c-9e10-4057-ad54-03d4450f6306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb3a15c-9e10-4057-ad54-03d4450f6306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c287fe8b-6f3b-46ba-b05e-23940b75679b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c287fe8b-6f3b-46ba-b05e-23940b75679b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bccd0db-cea1-4151-a9d7-6b068c7675fe', 'volume_name': 'volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b15958c-993b-4eec-a369-ecf5ac00547e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b15958c-993b-4eec-a369-ecf5ac00547e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad7c9e8-7d62-4a69-8670-ee4b6da57a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:38 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Volume 3bccd0db-cea1-4151-a9d7-6b068c7675fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe', 'volume_size': 1}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-648274751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bccd0db-cea1-4151-a9d7-6b068c7675fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:39Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Creating volume 3bccd0db-cea1-4151-a9d7-6b068c7675fe {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:38 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:38 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe 1073741824
Sep 29 12:44:38 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:39 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe 1073741824" returned: 0 in 0.516s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:39 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe
Sep 29 12:44:39 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:39 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe" returned: 0 in 0.289s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.228s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] Creating offline snapshot 65654dc3-80e7-4e0d-bba3-d124d0977589 of volume 753c781f-f3f5-4cee-ab93-7d63a613315d {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad7c9e8-7d62-4a69-8670-ee4b6da57a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d2c8ea-3857-4daa-8354-66b3baa43da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eed50e5-ff62-44e8-8fff-616098696e8e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:39 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Volume volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe (3bccd0db-cea1-4151-a9d7-6b068c7675fe): created successfully
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d2c8ea-3857-4daa-8354-66b3baa43da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (8c379191-4fe2-46c9-9b68-26191cd80629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-f750681f-a95e-4cab-b924-9a92e1d56bad tempest-ProjectMemberTests-222694199 None] Created volume successfully.
Sep 29 12:44:39 devstack sudo[107121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d
Sep 29 12:44:39 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:40 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d" returned: 0 in 0.374s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:40 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589 1G
Sep 29 12:44:40 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:40 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589 1G" returned: 0 in 0.442s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-753c781f-f3f5-4cee-ab93-7d63a613315d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:40 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-753c781f-f3f5-4cee-ab93-7d63a613315d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589
Sep 29 12:44:40 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:40 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-753c781f-f3f5-4cee-ab93-7d63a613315d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589" returned: 0 in 0.337s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:40 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589 is being set with open permissions: ugo+rw
Sep 29 12:44:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:40 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589
Sep 29 12:44:41 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:41 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589" returned: 0 in 0.282s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:41 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.info
Sep 29 12:44:41 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:41 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.info" returned: 0 in 0.258s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:41 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.info is being set with open permissions: ugo+rw
Sep 29 12:44:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:41 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.info
Sep 29 12:44:41 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:41 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.info" returned: 0 in 0.248s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.025s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.713s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] Creating offline snapshot 98e99206-298b-46c1-8fd0-011fb2d8a0d8 of volume 3bccd0db-cea1-4151-a9d7-6b068c7675fe {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:44:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fe03889c-23f3-418e-8a6a-2818ea05c834 tempest-ProjectReaderTests-871661053 None] Create snapshot completed successfully
Sep 29 12:44:41 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fd78a9-05d4-4690-8104-b36e290a485a]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:41 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe
Sep 29 12:44:41 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:42 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe" returned: 0 in 0.361s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:42 devstack sudo[107151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8 1G
Sep 29 12:44:42 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:42 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8 1G" returned: 0 in 0.397s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:42 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8
Sep 29 12:44:42 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-65654dc3-80e7-4e0d-bba3-d124d0977589-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Lock "cinder-65654dc3-80e7-4e0d-bba3-d124d0977589-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-753c781f-f3f5-4cee-ab93-7d63a613315d" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-753c781f-f3f5-4cee-ab93-7d63a613315d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-65654dc3-80e7-4e0d-bba3-d124d0977589" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-65654dc3-80e7-4e0d-bba3-d124d0977589" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Deleting offline snapshot 65654dc3-80e7-4e0d-bba3-d124d0977589 of volume 753c781f-f3f5-4cee-ab93-7d63a613315d {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] snapshot_file for this snap is: volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[475ff608-f4f1-401f-98e1-889e1475e622]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:42 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:42 devstack sudo[107159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589
Sep 29 12:44:42 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8" returned: 0 in 0.316s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:42 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8 is being set with open permissions: ugo+rw
Sep 29 12:44:42 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:42 devstack sudo[107164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8
Sep 29 12:44:42 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:43 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8" returned: 0 in 0.252s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:43 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589" returned: 0 in 0.397s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-753c781f-f3f5-4cee-ab93-7d63a613315d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:44:43 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.info
Sep 29 12:44:43 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0adde5c-d405-43ec-a4ba-edfbc6677e48]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:43 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d
Sep 29 12:44:43 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:43 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.info" returned: 0 in 0.266s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:43 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.info is being set with open permissions: ugo+rw
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:43 devstack sudo[107175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.info
Sep 29 12:44:43 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:43 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d" returned: 0 in 0.379s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:43 devstack sudo[107180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589
Sep 29 12:44:43 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:43 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.info" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:43 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-3702cfba-2eee-45dd-a837-38360b81fa64 tempest-ProjectMemberTests-222694199 None] Create snapshot completed successfully
Sep 29 12:44:43 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589" returned: 0 in 0.356s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:43 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:44 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589
Sep 29 12:44:44 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:44 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d.65654dc3-80e7-4e0d-bba3-d124d0977589" returned: 0 in 0.252s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-98e99206-298b-46c1-8fd0-011fb2d8a0d8-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-65654dc3-80e7-4e0d-bba3-d124d0977589" released by "_delete_snapshot" :: held 1.505s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Lock "cinder-98e99206-298b-46c1-8fd0-011fb2d8a0d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-3bccd0db-cea1-4151-a9d7-6b068c7675fe" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-753c781f-f3f5-4cee-ab93-7d63a613315d" released by "delete_snapshot" :: held 1.527s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-3bccd0db-cea1-4151-a9d7-6b068c7675fe" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-98e99206-298b-46c1-8fd0-011fb2d8a0d8" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-98e99206-298b-46c1-8fd0-011fb2d8a0d8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Deleting offline snapshot 98e99206-298b-46c1-8fd0-011fb2d8a0d8 of volume 3bccd0db-cea1-4151-a9d7-6b068c7675fe {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] snapshot_file for this snap is: volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9bfbfc-2166-4bc8-abe1-caa12cc81f16]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Created reservations ['460ccba3-8ba1-4ec3-bb4c-ed957c032ff3', '6399c567-5829-47cc-afa3-172f48676c8b', 'c790e543-17b8-484e-b503-5589d3fa2ef2', '40bb5553-2955-425d-8302-f7bccc51bec8'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:44 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Delete snapshot completed successfully.
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-152c9c41-5fa9-4c9d-9299-b52bc51c9757 tempest-ProjectReaderTests-871661053 None] Lock "cinder-65654dc3-80e7-4e0d-bba3-d124d0977589-delete_snapshot" released by "delete_snapshot" :: held 1.729s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:44 devstack sudo[107189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8
Sep 29 12:44:44 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:44 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8" returned: 0 in 0.368s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[13488cf9-66a7-40f9-84dd-cf92d43fe28f]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:44 devstack sudo[107195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-753c781f-f3f5-4cee-ab93-7d63a613315d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:44 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Lock "cinder-753c781f-f3f5-4cee-ab93-7d63a613315d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-753c781f-f3f5-4cee-ab93-7d63a613315d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:44 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-753c781f-f3f5-4cee-ab93-7d63a613315d" acquired by "delete_volume" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[42962685-2d99-4b85-9d7b-522209655590]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:45 devstack sudo[107197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d
Sep 29 12:44:45 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:45 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe" returned: 0 in 0.441s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:45 devstack sudo[107202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8
Sep 29 12:44:45 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:45 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d" returned: 0 in 0.385s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:45 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d
Sep 29 12:44:45 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:45 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8" returned: 0 in 0.347s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:45 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8
Sep 29 12:44:45 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:45 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-753c781f-f3f5-4cee-ab93-7d63a613315d" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-753c781f-f3f5-4cee-ab93-7d63a613315d" released by "delete_volume" :: held 0.740s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Created reservations ['5e101486-767a-432d-8629-a42b259ef80c', 'eb26b98b-e281-49b9-9d68-586e2a9072fb', '6101835f-1848-4926-936e-2ff605159c2a', '015feb25-ea97-459f-bbc0-eb4b005191b6'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:45 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe.98e99206-298b-46c1-8fd0-011fb2d8a0d8" returned: 0 in 0.280s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-98e99206-298b-46c1-8fd0-011fb2d8a0d8" released by "_delete_snapshot" :: held 1.540s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-3bccd0db-cea1-4151-a9d7-6b068c7675fe" released by "delete_snapshot" :: held 1.568s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:45 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:45 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:45 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Created reservations ['697bc8c0-963c-4c5c-974f-2c5be2656b4f', '01722496-04e0-4b6b-abbc-73bca696c230', 'e3c3455f-1416-414b-be14-3be8848bdda1', '20c62030-8b50-4eab-8367-bd494e22e25c'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:46 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Delete snapshot completed successfully.
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-a48656d1-9d4b-48de-9205-2d28ce4ccdab tempest-ProjectMemberTests-222694199 None] Lock "cinder-98e99206-298b-46c1-8fd0-011fb2d8a0d8-delete_snapshot" released by "delete_snapshot" :: held 1.770s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:46 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.252s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:46 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Deleted volume successfully.
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-287c1d02-6ef1-4788-a852-9823cd561297 tempest-ProjectReaderTests-871661053 None] Lock "cinder-753c781f-f3f5-4cee-ab93-7d63a613315d-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-3bccd0db-cea1-4151-a9d7-6b068c7675fe-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Lock "cinder-3bccd0db-cea1-4151-a9d7-6b068c7675fe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-3bccd0db-cea1-4151-a9d7-6b068c7675fe" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-3bccd0db-cea1-4151-a9d7-6b068c7675fe" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbac77f-242a-4afa-ab73-a9dc8aed072d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Flow 'volume_create_manager' (3a7c887a-ccd8-4cf7-9eae-cbd6e7bb05c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8732ba-915e-4f0e-a744-36e5d338048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8732ba-915e-4f0e-a744-36e5d338048a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1272431500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0089502d-d389-4fce-a83a-44b57c777d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4b9d60c0554e6d852d22644f59710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:47Z,use_quota=True,user_id='ff292419227045368c3f611020093b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d24961-7d73-46fb-8671-0562d6fb8ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d24961-7d73-46fb-8671-0562d6fb8ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d0b03b-1757-4d69-838f-d4cefaa5152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d0b03b-1757-4d69-838f-d4cefaa5152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0089502d-d389-4fce-a83a-44b57c777d6b', 'volume_name': 'volume-0089502d-d389-4fce-a83a-44b57c777d6b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9b6b42-db48-41ed-915f-eef7ac2b9b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9b6b42-db48-41ed-915f-eef7ac2b9b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d393c2b-1ae2-407d-8e53-bd057b5fa437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:46 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Volume 0089502d-d389-4fce-a83a-44b57c777d6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0089502d-d389-4fce-a83a-44b57c777d6b', 'volume_size': 1}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1272431500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0089502d-d389-4fce-a83a-44b57c777d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4b9d60c0554e6d852d22644f59710c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:47Z,use_quota=True,user_id='ff292419227045368c3f611020093b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Creating volume 0089502d-d389-4fce-a83a-44b57c777d6b {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:46 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe
Sep 29 12:44:46 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:46 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:46 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b 1073741824
Sep 29 12:44:46 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:46 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe" returned: 0 in 0.408s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:46 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:47 devstack sudo[107229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe
Sep 29 12:44:47 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:47 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b 1073741824" returned: 0 in 0.479s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:47 devstack sudo[107233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b
Sep 29 12:44:47 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:47 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3bccd0db-cea1-4151-a9d7-6b068c7675fe" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-3bccd0db-cea1-4151-a9d7-6b068c7675fe" released by "delete_volume" :: held 0.756s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Created reservations ['90121daf-104a-442c-8915-56f6bb123698', 'c0bf8588-52aa-4178-8711-f9ca319e3d88', '54a1be78-6b74-4bcd-9233-bf9051b51455', 'eb003d32-b6f5-41af-82a8-8b3ea6e65d70'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:47 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:47 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:47 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b" returned: 0 in 0.275s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d393c2b-1ae2-407d-8e53-bd057b5fa437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0089502d-d389-4fce-a83a-44b57c777d6b', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f710f9ff-08c5-495d-8fe9-d2ebc40d12ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:47 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Volume volume-0089502d-d389-4fce-a83a-44b57c777d6b (0089502d-d389-4fce-a83a-44b57c777d6b): created successfully
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f710f9ff-08c5-495d-8fe9-d2ebc40d12ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Flow 'volume_create_manager' (3a7c887a-ccd8-4cf7-9eae-cbd6e7bb05c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b81f3de5-9739-4805-a45f-7b9a43ae4b71 tempest-ProjectReaderTests-871661053 None] Created volume successfully.
Sep 29 12:44:47 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.274s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:47 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Deleted volume successfully.
Sep 29 12:44:47 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-c0cff053-50e7-4aac-a6c9-efe9bd1d31b9 tempest-ProjectMemberTests-222694199 None] Lock "cinder-3bccd0db-cea1-4151-a9d7-6b068c7675fe-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (7aa77c1d-1529-4fb7-b6b7-1e23d092b3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (febf5664-c149-4ca4-8d71-ecb7d8722891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (febf5664-c149-4ca4-8d71-ecb7d8722891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697001284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77fe02df-fe84-4d2b-a13e-a44a0dddb90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:48Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f5028f-941a-41a9-a029-8dab5b53ee13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f5028f-941a-41a9-a029-8dab5b53ee13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a70f65-97a3-42a5-b132-c41793112bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a70f65-97a3-42a5-b132-c41793112bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77fe02df-fe84-4d2b-a13e-a44a0dddb90d', 'volume_name': 'volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a639233f-7539-45cd-876f-ccc9fba1e0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a639233f-7539-45cd-876f-ccc9fba1e0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6b37fc-7bf5-4166-a51f-198a28eb708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:48 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Volume 77fe02df-fe84-4d2b-a13e-a44a0dddb90d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d', 'volume_size': 1}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697001284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77fe02df-fe84-4d2b-a13e-a44a0dddb90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ead90d0e2447e698ac0d1c2528f514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:44:48Z,use_quota=True,user_id='7c11bad7f8c148f6b9673e12aaa76c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Creating volume 77fe02df-fe84-4d2b-a13e-a44a0dddb90d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:44:48 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:48 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d 1073741824
Sep 29 12:44:48 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:48 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d 1073741824" returned: 0 in 0.442s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:48 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d
Sep 29 12:44:48 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:48 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d" returned: 0 in 0.287s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.133s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6b37fc-7bf5-4166-a51f-198a28eb708a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b43755-4a6c-4e90-95c9-f91b75faba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:44:48 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] Creating offline snapshot ba265129-9f5a-4b8b-9900-077480c14577 of volume 0089502d-d389-4fce-a83a-44b57c777d6b {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:44:49 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Volume volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d (77fe02df-fe84-4d2b-a13e-a44a0dddb90d): created successfully
Sep 29 12:44:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b43755-4a6c-4e90-95c9-f91b75faba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:44:49 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Flow 'volume_create_manager' (7aa77c1d-1529-4fb7-b6b7-1e23d092b3f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:44:49 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a754f0-6d26-4312-83f8-fa7111ebd12d]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:49 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-ec790002-8cbe-421d-be49-a87be6650100 tempest-ProjectMemberTests-222694199 None] Created volume successfully.
Sep 29 12:44:49 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b
Sep 29 12:44:49 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:49 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b" returned: 0 in 0.375s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:49 devstack sudo[107253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577 1G
Sep 29 12:44:49 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:49 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577 1G" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:49 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0089502d-d389-4fce-a83a-44b57c777d6b -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:49 devstack sudo[107258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0089502d-d389-4fce-a83a-44b57c777d6b -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577
Sep 29 12:44:49 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:50 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0089502d-d389-4fce-a83a-44b57c777d6b -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577" returned: 0 in 0.301s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:50 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577 is being set with open permissions: ugo+rw
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:50 devstack sudo[107264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577
Sep 29 12:44:50 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:50 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577" returned: 0 in 0.262s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:50 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.info
Sep 29 12:44:50 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:50 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.info" returned: 0 in 0.255s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:50 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.info is being set with open permissions: ugo+rw
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:50 devstack sudo[107270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.info
Sep 29 12:44:50 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:50 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.info" returned: 0 in 0.247s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.562s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] Creating offline snapshot dfc4d110-a99f-4a57-ae3c-c86ca3708aa1 of volume 77fe02df-fe84-4d2b-a13e-a44a0dddb90d {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:44:50 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-aa09c149-4e25-42b7-b578-2567387b4bde tempest-ProjectReaderTests-871661053 None] Create snapshot completed successfully
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[58295ad4-d261-488b-9293-3845a5a6d578]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:50 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:51 devstack sudo[107273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d
Sep 29 12:44:51 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:51 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d" returned: 0 in 0.365s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:51 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1 1G
Sep 29 12:44:51 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:51 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1 1G" returned: 0 in 0.384s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:51 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:51 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1
Sep 29 12:44:51 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:51 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-ba265129-9f5a-4b8b-9900-077480c14577-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:51 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:52 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1 is being set with open permissions: ugo+rw
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Lock "cinder-ba265129-9f5a-4b8b-9900-077480c14577-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-0089502d-d389-4fce-a83a-44b57c777d6b" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:52 devstack sudo[107288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1
Sep 29 12:44:52 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-0089502d-d389-4fce-a83a-44b57c777d6b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-ba265129-9f5a-4b8b-9900-077480c14577" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-ba265129-9f5a-4b8b-9900-077480c14577" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Deleting offline snapshot ba265129-9f5a-4b8b-9900-077480c14577 of volume 0089502d-d389-4fce-a83a-44b57c777d6b {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] snapshot_file for this snap is: volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51f76cd-7323-48d1-b9a2-5d47970da4db]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:52 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577
Sep 29 12:44:52 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:52 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1" returned: 0 in 0.272s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:52 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.info
Sep 29 12:44:52 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:52 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577" returned: 0 in 0.400s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0089502d-d389-4fce-a83a-44b57c777d6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2fe4f4-e244-4e2c-9371-7d96e07ad515]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:52 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.info" returned: 0 in 0.268s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:52 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.info is being set with open permissions: ugo+rw
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:52 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.info
Sep 29 12:44:52 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:52 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b
Sep 29 12:44:52 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:52 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.info" returned: 0 in 0.237s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:52 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-41b8b1ec-5e51-4105-8abb-49903f8198bc tempest-ProjectMemberTests-222694199 None] Create snapshot completed successfully
Sep 29 12:44:52 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b" returned: 0 in 0.393s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:52 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:52 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577
Sep 29 12:44:52 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:53 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577" returned: 0 in 0.328s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:53 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577
Sep 29 12:44:53 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:53 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b.ba265129-9f5a-4b8b-9900-077480c14577" returned: 0 in 0.277s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-ba265129-9f5a-4b8b-9900-077480c14577" released by "_delete_snapshot" :: held 1.511s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-0089502d-d389-4fce-a83a-44b57c777d6b" released by "delete_snapshot" :: held 1.531s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-dfc4d110-a99f-4a57-ae3c-c86ca3708aa1-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Lock "cinder-dfc4d110-a99f-4a57-ae3c-c86ca3708aa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-77fe02df-fe84-4d2b-a13e-a44a0dddb90d" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Created reservations ['5d50811a-d5ad-4384-9db4-92254f58661b', 'eaa44ff9-2790-4e3d-ac1a-083a7805596b', '4c4d6d6c-740f-43e1-927b-b5f5b7b94a4c', 'f65e8982-f020-434e-b9e7-fcf0e36b38da'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-77fe02df-fe84-4d2b-a13e-a44a0dddb90d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-dfc4d110-a99f-4a57-ae3c-c86ca3708aa1" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-dfc4d110-a99f-4a57-ae3c-c86ca3708aa1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Deleting offline snapshot dfc4d110-a99f-4a57-ae3c-c86ca3708aa1 of volume 77fe02df-fe84-4d2b-a13e-a44a0dddb90d {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] snapshot_file for this snap is: volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ccc17b-5205-427e-81dd-9e851da674ac]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:53 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Delete snapshot completed successfully.
Sep 29 12:44:53 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-aef08fb7-d8dd-4788-a2ec-ff3a1c4472f1 tempest-ProjectReaderTests-871661053 None] Lock "cinder-ba265129-9f5a-4b8b-9900-077480c14577-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:53 devstack sudo[107316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1
Sep 29 12:44:53 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:54 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1" returned: 0 in 0.394s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-0089502d-d389-4fce-a83a-44b57c777d6b-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f706984-937c-464c-81fe-8b5c0304c058]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Lock "cinder-0089502d-d389-4fce-a83a-44b57c777d6b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Acquiring lock "cinder-quobyte-0089502d-d389-4fce-a83a-44b57c777d6b" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-0089502d-d389-4fce-a83a-44b57c777d6b" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8624442-07a1-4dfb-baaa-e9c3624cdd52]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:54 devstack sudo[107321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d
Sep 29 12:44:54 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:54 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b
Sep 29 12:44:54 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:54 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d" returned: 0 in 0.405s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:54 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1
Sep 29 12:44:54 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:54 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b" returned: 0 in 0.387s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:54 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b
Sep 29 12:44:54 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:54 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-0089502d-d389-4fce-a83a-44b57c777d6b" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:54 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Lock "cinder-quobyte-0089502d-d389-4fce-a83a-44b57c777d6b" released by "delete_volume" :: held 0.721s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1" returned: 0 in 0.390s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:54 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:55 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1
Sep 29 12:44:55 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Created reservations ['67aaff72-fab4-41e1-8538-b91c793c87eb', 'fbf3038d-f191-42b4-b242-d1c75bb974ac', 'e730da55-f75d-407d-8849-449c24c08721', '4b92854e-5d04-475b-97a6-57ee940338b2'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:55 devstack sudo[107342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:55 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:55 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d.dfc4d110-a99f-4a57-ae3c-c86ca3708aa1" returned: 0 in 0.257s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-dfc4d110-a99f-4a57-ae3c-c86ca3708aa1" released by "_delete_snapshot" :: held 1.582s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-77fe02df-fe84-4d2b-a13e-a44a0dddb90d" released by "delete_snapshot" :: held 1.609s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Created reservations ['eecd61a3-b0e8-4ee6-8fad-b8d4a6a57659', '3fe08779-da1e-426b-85ca-160495cc8b64', '7dad4956-e08a-407a-8c98-44446b2eede0', '6284e833-a7e0-4761-93e6-054191a47e34'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:55 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.302s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Deleted volume successfully.
Sep 29 12:44:55 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Delete snapshot completed successfully.
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-53da824b-8226-4763-8d4e-28312dcc0720 tempest-ProjectMemberTests-222694199 None] Lock "cinder-dfc4d110-a99f-4a57-ae3c-c86ca3708aa1-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-456c6a94-deb6-4d96-b296-6ea815809837 tempest-ProjectReaderTests-871661053 None] Lock "cinder-0089502d-d389-4fce-a83a-44b57c777d6b-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-77fe02df-fe84-4d2b-a13e-a44a0dddb90d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Lock "cinder-77fe02df-fe84-4d2b-a13e-a44a0dddb90d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Acquiring lock "cinder-quobyte-77fe02df-fe84-4d2b-a13e-a44a0dddb90d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-77fe02df-fe84-4d2b-a13e-a44a0dddb90d" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[faceb02c-ab77-4555-82c2-9ddcef1f0dd0]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:44:55 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:56 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d
Sep 29 12:44:56 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:56 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d" returned: 0 in 0.418s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:56 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d
Sep 29 12:44:56 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:56 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-77fe02df-fe84-4d2b-a13e-a44a0dddb90d" returned: 0 in 0.295s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:56 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Lock "cinder-quobyte-77fe02df-fe84-4d2b-a13e-a44a0dddb90d" released by "delete_volume" :: held 0.806s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:44:56 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Created reservations ['90e5b7dc-064e-46ca-885e-0978e82536e0', 'c736b8dd-3151-474a-861f-09b523ebb2c9', '892ac9be-fa83-47ed-83ca-26c8674b4042', '82fbb2e9-0750-4914-accc-07a58b86342f'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:44:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:44:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:44:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:44:56 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:44:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:44:56 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:44:56 devstack sudo[107354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:44:56 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:44:57 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root
Sep 29 12:44:57 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.294s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:44:57 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:44:57 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Deleted volume successfully.
Sep 29 12:44:57 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-0016ccfb-0372-4a62-91cf-976b914df005 tempest-ProjectMemberTests-222694199 None] Lock "cinder-77fe02df-fe84-4d2b-a13e-a44a0dddb90d-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:06 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=170,cinder:INSERT=61,cinder:UPDATE=254,cinder:DELETE=23 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:45:07 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=194,cinder:INSERT=68,cinder:UPDATE=224,cinder:DELETE=17 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:45:07 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:45:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:07 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:07 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:07 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:45:07 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:08 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:08 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:08 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:45:08 devstack cinder-volume[86369]: DEBUG oslo_service.periodic_task [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] Running periodic task VolumeManager._thread_info {{(pid=86369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 12:45:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread count: 29 {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 12:45:08 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-ec5c5da2-ef96-44f4-8eec-998b7746c08c None None] thread info: [<_MainThread(MainThread, started 135721716625536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135721602702656)>, <Thread(Thread-3 (stat_writer), started daemon 135721603478656)>, <Thread(Rabbit-heartbeat, started daemon 135721600385344)>, <Thread(Thread-5 (_runner), started daemon 135721600462080)>, <Thread(Thread-7 (_runner), started daemon 135721600570688)>, <Thread(fd_logger, started daemon 135721598407872)>, <Thread(privsep_reader, started daemon 135721598416192)>, <Thread(tpool_thread_0, started daemon 135721592882880)>, <Thread(tpool_thread_1, started daemon 135721584490176)>, <Thread(tpool_thread_2, started daemon 135721576097472)>, <Thread(tpool_thread_3, started daemon 135721567688384)>, <Thread(tpool_thread_4, started daemon 135721559279296)>, <Thread(tpool_thread_5, started daemon 135721550870208)>, <Thread(tpool_thread_6, started daemon 135721542461120)>, <Thread(tpool_thread_7, started daemon 135721534052032)>, <Thread(tpool_thread_8, started daemon 135721525642944)>, <Thread(tpool_thread_9, started daemon 135721517233856)>, <Thread(tpool_thread_10, started daemon 135721508824768)>, <Thread(tpool_thread_11, started daemon 135721500415680)>, <Thread(tpool_thread_12, started daemon 135721492006592)>, <Thread(tpool_thread_13, started daemon 135721483597504)>, <Thread(tpool_thread_14, started daemon 135721475188416)>, <Thread(tpool_thread_15, started daemon 135721466779328)>, <Thread(tpool_thread_16, started daemon 135721458370240)>, <Thread(tpool_thread_17, started daemon 135721449961152)>, <Thread(tpool_thread_18, started daemon 135721441552064)>, <Thread(tpool_thread_19, started daemon 135721433142976)>, <Thread(Rabbit-heartbeat, started daemon 135721594340992)>] {{(pid=86369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Flow 'volume_create_manager' (7dbabe18-1ecc-41dd-a14a-04900983962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2d111f-7348-4af8-a162-98bb33eec581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2d111f-7348-4af8-a162-98bb33eec581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2023895805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e80ad6e-1fc6-46ab-b723-d6f50e38766d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f099b816a34fc1959592f5cc2d9bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:19Z,use_quota=True,user_id='580754e7749f4cddba7fbb73c57ff968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d95f614-0cb3-4612-8bc2-e979a76db9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d95f614-0cb3-4612-8bc2-e979a76db9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bf22b4-622e-4028-8589-947a0bdea54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bf22b4-622e-4028-8589-947a0bdea54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e80ad6e-1fc6-46ab-b723-d6f50e38766d', 'volume_name': 'volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2727aa9-d47d-4443-999f-bbc0677fb922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2727aa9-d47d-4443-999f-bbc0677fb922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f84c8db-bccb-464a-a7da-ef2bbe705c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:18 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Volume 3e80ad6e-1fc6-46ab-b723-d6f50e38766d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d', 'volume_size': 1}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2023895805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e80ad6e-1fc6-46ab-b723-d6f50e38766d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f099b816a34fc1959592f5cc2d9bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:19Z,use_quota=True,user_id='580754e7749f4cddba7fbb73c57ff968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Creating volume 3e80ad6e-1fc6-46ab-b723-d6f50e38766d {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:45:18 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:45:18 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:18 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d 1073741824
Sep 29 12:45:18 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:19 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d 1073741824" returned: 0 in 0.473s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:19 devstack sudo[107417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d
Sep 29 12:45:19 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:19 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d" returned: 0 in 0.259s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:19 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:45:19 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f84c8db-bccb-464a-a7da-ef2bbe705c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67660ad3-9af8-4827-8367-0ec1bc369c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:19 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Volume volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d (3e80ad6e-1fc6-46ab-b723-d6f50e38766d): created successfully
Sep 29 12:45:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67660ad3-9af8-4827-8367-0ec1bc369c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:19 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Flow 'volume_create_manager' (7dbabe18-1ecc-41dd-a14a-04900983962e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:45:19 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-61502a46-ab50-4912-b517-46f214e9a269 tempest-SnapshotDependencyTests-1332276379 None] Created volume successfully.
Sep 29 12:45:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:21 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] Creating offline snapshot 78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 of volume 3e80ad6e-1fc6-46ab-b723-d6f50e38766d {{(pid=86369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 12:45:21 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e291b96-5324-48fb-be1d-7e5bbbc00d50]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:45:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:21 devstack sudo[107420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d
Sep 29 12:45:21 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:21 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d" returned: 0 in 0.376s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 1G {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:21 devstack sudo[107425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 1G
Sep 29 12:45:21 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:21 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 1G" returned: 0 in 0.432s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:21 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:21 devstack sudo[107431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9
Sep 29 12:45:21 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:22 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d -F qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9" returned: 0 in 0.310s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:22 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 is being set with open permissions: ugo+rw
Sep 29 12:45:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:22 devstack sudo[107436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9
Sep 29 12:45:22 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:22 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9" returned: 0 in 0.260s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:22 devstack sudo[107439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.info
Sep 29 12:45:22 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:22 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.info" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:22 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.info is being set with open permissions: ugo+rw
Sep 29 12:45:22 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.info {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:22 devstack sudo[107442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.info
Sep 29 12:45:22 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:23 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.info" returned: 0 in 0.266s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:23 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-21fa3ff3-a2fe-4278-a8e4-917e3cd46ec8 tempest-SnapshotDependencyTests-1332276379 None] Create snapshot completed successfully
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Flow 'volume_create_manager' (22fede0a-5ac1-458c-9435-40c0fcbe123c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a594c9b6-66be-45e5-9e51-52163bac5b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a594c9b6-66be-45e5-9e51-52163bac5b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-915432073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6726270-f25f-459f-9ad7-928f297a9408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af12f0384bc24e74869c98c7bd85e092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:23Z,use_quota=True,user_id='21f9ea082d7a4fa590a95d7bf57b6795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a210df9-75d6-4aa0-a314-1d885af01101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a210df9-75d6-4aa0-a314-1d885af01101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc6100c-5ac2-459c-bbf0-349ed9d13891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc6100c-5ac2-459c-bbf0-349ed9d13891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6726270-f25f-459f-9ad7-928f297a9408', 'volume_name': 'volume-d6726270-f25f-459f-9ad7-928f297a9408', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0558b5-5194-4799-9e77-ba67cff5e602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0558b5-5194-4799-9e77-ba67cff5e602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac3dd87-3d24-44f2-82ab-8d60a8945199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:23 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Volume d6726270-f25f-459f-9ad7-928f297a9408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6726270-f25f-459f-9ad7-928f297a9408', 'volume_size': 1}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-915432073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6726270-f25f-459f-9ad7-928f297a9408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af12f0384bc24e74869c98c7bd85e092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:23Z,use_quota=True,user_id='21f9ea082d7a4fa590a95d7bf57b6795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Creating volume d6726270-f25f-459f-9ad7-928f297a9408 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:45:23 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d6726270-f25f-459f-9ad7-928f297a9408 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:23 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d6726270-f25f-459f-9ad7-928f297a9408 1073741824
Sep 29 12:45:23 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:23 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d6726270-f25f-459f-9ad7-928f297a9408 1073741824" returned: 0 in 0.432s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:23 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d6726270-f25f-459f-9ad7-928f297a9408 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:23 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d6726270-f25f-459f-9ad7-928f297a9408
Sep 29 12:45:23 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:24 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d6726270-f25f-459f-9ad7-928f297a9408" returned: 0 in 0.248s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac3dd87-3d24-44f2-82ab-8d60a8945199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6726270-f25f-459f-9ad7-928f297a9408', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffedbf6-a5d5-4936-a4b2-76ea858ee324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Volume volume-d6726270-f25f-459f-9ad7-928f297a9408 (d6726270-f25f-459f-9ad7-928f297a9408): created successfully
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffedbf6-a5d5-4936-a4b2-76ea858ee324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Flow 'volume_create_manager' (22fede0a-5ac1-458c-9435-40c0fcbe123c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:45:24 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-a95d8866-6393-4fb8-af01-df076e6ece3d tempest-ProjectReaderTests-791209559 None] Created volume successfully.
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Acquiring lock "cinder-d6726270-f25f-459f-9ad7-928f297a9408-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Lock "cinder-d6726270-f25f-459f-9ad7-928f297a9408-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Acquiring lock "cinder-quobyte-d6726270-f25f-459f-9ad7-928f297a9408" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Lock "cinder-quobyte-d6726270-f25f-459f-9ad7-928f297a9408" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc9e347-7249-4bf0-ac44-da26b0c400b2]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d6726270-f25f-459f-9ad7-928f297a9408 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:24 devstack sudo[107454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d6726270-f25f-459f-9ad7-928f297a9408
Sep 29 12:45:24 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:45:24 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Flow 'volume_create_manager' (b42d49e7-f47e-4f68-aa37-90e6eb566a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e1205c-9aec-4f60-a807-bd64851ef57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d6726270-f25f-459f-9ad7-928f297a9408" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d6726270-f25f-459f-9ad7-928f297a9408 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e1205c-9aec-4f60-a807-bd64851ef57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f6dd68-9fd3-4009-8cb7-32371eb8c3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f099b816a34fc1959592f5cc2d9bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:25Z,use_quota=True,user_id='580754e7749f4cddba7fbb73c57ff968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:24 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d6726270-f25f-459f-9ad7-928f297a9408
Sep 29 12:45:24 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302f3f3a-f38c-4fdb-96cc-88a751f6fe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302f3f3a-f38c-4fdb-96cc-88a751f6fe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3676c4-7c6f-40f8-8a78-47e2cf7d8975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c3676c4-7c6f-40f8-8a78-47e2cf7d8975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '03f6dd68-9fd3-4009-8cb7-32371eb8c3ba', 'volume_name': 'volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba', 'volume_size': 1, 'snapshot_id': '78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e35e9a-99fc-48ee-bacf-d8f739049f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e35e9a-99fc-48ee-bacf-d8f739049f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b70dd0b-2275-4ae5-a1d0-ce201629c410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:24 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Volume 03f6dd68-9fd3-4009-8cb7-32371eb8c3ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba', 'volume_size': 1, 'snapshot_id': '78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9'}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "cinder-quobyte-78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" by "_create_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-quobyte-78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Creating volume 03f6dd68-9fd3-4009-8cb7-32371eb8c3ba from snapshot 78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 {{(pid=86369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:45:24 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "cinder-quobyte-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" by "_copy_volume_from_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-quobyte-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] snapshot: 78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9, volume: 03f6dd68-9fd3-4009-8cb7-32371eb8c3ba,  {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[27823088-f25e-4346-8948-8f3ffa4960da]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:25 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-d6726270-f25f-459f-9ad7-928f297a9408" returned: 0 in 0.299s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:25 devstack sudo[107462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9
Sep 29 12:45:25 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Lock "cinder-quobyte-d6726270-f25f-459f-9ad7-928f297a9408" released by "delete_volume" :: held 0.763s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Created reservations ['55c76337-6d8a-4583-babf-3cbff3ebe601', '5973b541-a011-4211-b243-1065c83ce59b', 'eff966a3-17b5-4a8d-b47a-0e06ccf88e4b', '2f58a0fa-6368-4395-a1e7-a67e5058fd3b'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:25 devstack sudo[107465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:45:25 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:25 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9" returned: 0 in 0.407s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[246eb9d6-7cae-47a8-a412-9b5229f730d2]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:25 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.287s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:45:25 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Deleted volume successfully.
Sep 29 12:45:25 devstack sudo[107470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d
Sep 29 12:45:25 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-90fb58ac-9147-4eea-9ef5-2cf90baa5418 tempest-ProjectReaderTests-791209559 None] Lock "cinder-d6726270-f25f-459f-9ad7-928f297a9408-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:25 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d" returned: 0 in 0.454s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Creating direct copy from snapshot {{(pid=86369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG cinder.utils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Path /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba not found in is_blk_device check {{(pid=86369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 12:45:25 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:25 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba
Sep 29 12:45:25 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:26 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:45:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Flow 'volume_create_manager' (f40167fe-f9e8-46d5-9bce-de7aa24464be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:45:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69eaf44c-8eee-4141-9c07-4c29ba7ab4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69eaf44c-8eee-4141-9c07-4c29ba7ab4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-411503361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad62854e-c943-44e2-94d6-e27800952320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af12f0384bc24e74869c98c7bd85e092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:26Z,use_quota=True,user_id='21f9ea082d7a4fa590a95d7bf57b6795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac4bbe5-f3c1-4afc-8121-e9ef96c26577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac4bbe5-f3c1-4afc-8121-e9ef96c26577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12d24c6-8163-4990-98f7-382b7bd7e072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12d24c6-8163-4990-98f7-382b7bd7e072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad62854e-c943-44e2-94d6-e27800952320', 'volume_name': 'volume-ad62854e-c943-44e2-94d6-e27800952320', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7855b9d-63d0-4664-84c8-722fbbf83e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7855b9d-63d0-4664-84c8-722fbbf83e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:26 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0371f4e-d994-44a8-94bc-75800a397ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:26 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Volume ad62854e-c943-44e2-94d6-e27800952320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad62854e-c943-44e2-94d6-e27800952320', 'volume_size': 1}
Sep 29 12:45:26 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:31 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" returned: 0 in 6.000s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:31 devstack cinder-volume[86369]: DEBUG cinder.image.image_utils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba {{(pid=86369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 12:45:31 devstack cinder-volume[86369]: INFO cinder.image.image_utils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Converted 1024.00 MB image at 170.63 MB/s
Sep 29 12:45:31 devstack cinder-volume[86369]: WARNING cinder.volume.drivers.remotefs [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba is being set with open permissions: ugo+rw
Sep 29 12:45:31 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:31 devstack sudo[107490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba
Sep 29 12:45:31 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:32 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" returned: 0 in 0.239s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-quobyte-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" released by "_copy_volume_from_snapshot" :: held 7.185s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-quobyte-78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" released by "_create_volume_from_snapshot" :: held 7.257s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.275s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.077s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-411503361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad62854e-c943-44e2-94d6-e27800952320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af12f0384bc24e74869c98c7bd85e092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:26Z,use_quota=True,user_id='21f9ea082d7a4fa590a95d7bf57b6795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Creating volume ad62854e-c943-44e2-94d6-e27800952320 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:45:32 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad62854e-c943-44e2-94d6-e27800952320 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:32 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad62854e-c943-44e2-94d6-e27800952320 1073741824
Sep 29 12:45:32 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b70dd0b-2275-4ae5-a1d0-ce201629c410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba', 'volume_size': 1, 'snapshot_id': '78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9'}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da40e42c-0b05-4e6e-92c8-f4e1388b8657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:32 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Volume volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba (03f6dd68-9fd3-4009-8cb7-32371eb8c3ba): created successfully
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da40e42c-0b05-4e6e-92c8-f4e1388b8657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Flow 'volume_create_manager' (b42d49e7-f47e-4f68-aa37-90e6eb566a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:45:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-5f26010b-dda1-46d8-ad1b-20554b18f797 tempest-SnapshotDependencyTests-1332276379 None] Created volume successfully.
Sep 29 12:45:32 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad62854e-c943-44e2-94d6-e27800952320 1073741824" returned: 0 in 0.420s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad62854e-c943-44e2-94d6-e27800952320 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:32 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad62854e-c943-44e2-94d6-e27800952320
Sep 29 12:45:32 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:32 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad62854e-c943-44e2-94d6-e27800952320" returned: 0 in 0.236s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0371f4e-d994-44a8-94bc-75800a397ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad62854e-c943-44e2-94d6-e27800952320', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a8706a-4cbc-47c1-bb66-020583733404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:32 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Volume volume-ad62854e-c943-44e2-94d6-e27800952320 (ad62854e-c943-44e2-94d6-e27800952320): created successfully
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a8706a-4cbc-47c1-bb66-020583733404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:32 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Flow 'volume_create_manager' (f40167fe-f9e8-46d5-9bce-de7aa24464be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:45:32 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-86d94428-00ec-4487-b682-26ff5aa0abd4 tempest-ProjectReaderTests-791209559 None] Created volume successfully.
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "cinder-78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9-delete_snapshot" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "cinder-quobyte-3e80ad6e-1fc6-46ab-b723-d6f50e38766d" by "delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-quobyte-3e80ad6e-1fc6-46ab-b723-d6f50e38766d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "cinder-quobyte-78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9" by "_delete_snapshot" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-quobyte-78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Deleting offline snapshot 78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 of volume 3e80ad6e-1fc6-46ab-b723-d6f50e38766d {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] snapshot_file for this snap is: volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 {{(pid=86369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fda1125-76ce-4cb2-b2cf-24b736689a13]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:33 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9
Sep 29 12:45:33 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Acquiring lock "cinder-ad62854e-c943-44e2-94d6-e27800952320-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Lock "cinder-ad62854e-c943-44e2-94d6-e27800952320-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Acquiring lock "cinder-quobyte-ad62854e-c943-44e2-94d6-e27800952320" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Lock "cinder-quobyte-ad62854e-c943-44e2-94d6-e27800952320" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:33 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b90ec3-fd3d-4df6-8a65-371e698cc8d3]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad62854e-c943-44e2-94d6-e27800952320 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9" returned: 0 in 0.406s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[932cc218-379f-47ac-87b6-65b4cda5c0a9]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:45:33 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:34 devstack sudo[107509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad62854e-c943-44e2-94d6-e27800952320
Sep 29 12:45:34 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:34 devstack sudo[107510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d
Sep 29 12:45:34 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:34 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad62854e-c943-44e2-94d6-e27800952320" returned: 0 in 0.386s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad62854e-c943-44e2-94d6-e27800952320 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:34 devstack sudo[107518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad62854e-c943-44e2-94d6-e27800952320
Sep 29 12:45:34 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:34 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d" returned: 0 in 0.561s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:34 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:34 devstack sudo[107522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9
Sep 29 12:45:34 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ad62854e-c943-44e2-94d6-e27800952320" returned: 0 in 0.249s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Lock "cinder-quobyte-ad62854e-c943-44e2-94d6-e27800952320" released by "delete_volume" :: held 0.682s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Created reservations ['dc3a7efb-9f27-4991-b1e2-75598d66ab91', '4a2c1dfc-5fe3-4cc0-a5dd-98cde9ab9418', '9079a055-1bf1-4029-bc35-42106b92248f', 'a9fac6d3-6275-47a6-9d95-cc5c1e15e62d'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:34 devstack sudo[107524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:45:34 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:34 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9" returned: 0 in 0.323s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:34 devstack sudo[107530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9
Sep 29 12:45:34 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:34 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.280s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:34 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:45:34 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Deleted volume successfully.
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-b6703950-03e9-432d-b563-a776e213b6db tempest-ProjectReaderTests-791209559 None] Lock "cinder-ad62854e-c943-44e2-94d6-e27800952320-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:35 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d.78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9" returned: 0 in 0.278s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-quobyte-78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9" released by "_delete_snapshot" :: held 1.680s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-quobyte-3e80ad6e-1fc6-46ab-b723-d6f50e38766d" released by "delete_snapshot" :: held 1.702s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Created reservations ['885a0d91-7fe6-4197-bfd7-e18d86ff1aee', '800e74e4-dbb9-4edd-b877-2901501072de', '4cb6cc4b-aee8-4819-be57-9c51da881070', '415ea256-0759-466c-b696-e54ce91117ba'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:45:35 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Delete snapshot completed successfully.
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-13ffe8e3-2882-472c-a93b-baccf3a7af3b tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-78d5b5f8-1a92-4cfd-8545-3d5afc4c40a9-delete_snapshot" released by "delete_snapshot" :: held 1.850s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Flow 'volume_create_manager' (e29249a6-8225-4186-adc4-6fc95a99026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41f5073-666f-4b9e-8e9c-44e4ed9178e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41f5073-666f-4b9e-8e9c-44e4ed9178e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97115943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff483115-5a56-446a-90de-e544c5ee4c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af12f0384bc24e74869c98c7bd85e092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:35Z,use_quota=True,user_id='21f9ea082d7a4fa590a95d7bf57b6795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ddf75f-c4db-49ec-821f-5277b0756db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ddf75f-c4db-49ec-821f-5277b0756db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04d2840-f8a8-4eee-a9d0-b097c841deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04d2840-f8a8-4eee-a9d0-b097c841deba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff483115-5a56-446a-90de-e544c5ee4c6c', 'volume_name': 'volume-ff483115-5a56-446a-90de-e544c5ee4c6c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeeae372-b7f2-4989-94cc-7582bd515fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeeae372-b7f2-4989-94cc-7582bd515fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961aed49-bdb4-4006-854a-3068917d457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:35 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Volume ff483115-5a56-446a-90de-e544c5ee4c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff483115-5a56-446a-90de-e544c5ee4c6c', 'volume_size': 1}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97115943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff483115-5a56-446a-90de-e544c5ee4c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af12f0384bc24e74869c98c7bd85e092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:35Z,use_quota=True,user_id='21f9ea082d7a4fa590a95d7bf57b6795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Creating volume ff483115-5a56-446a-90de-e544c5ee4c6c {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:45:35 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ff483115-5a56-446a-90de-e544c5ee4c6c 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:35 devstack sudo[107534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ff483115-5a56-446a-90de-e544c5ee4c6c 1073741824
Sep 29 12:45:35 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "cinder-3e80ad6e-1fc6-46ab-b723-d6f50e38766d-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-3e80ad6e-1fc6-46ab-b723-d6f50e38766d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "cinder-quobyte-3e80ad6e-1fc6-46ab-b723-d6f50e38766d" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-quobyte-3e80ad6e-1fc6-46ab-b723-d6f50e38766d" acquired by "delete_volume" :: waited 0.015s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3967216a-749b-4615-95ba-d0a9372d57e9]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:45:35 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:35 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d
Sep 29 12:45:35 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:35 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ff483115-5a56-446a-90de-e544c5ee4c6c 1073741824" returned: 0 in 0.458s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ff483115-5a56-446a-90de-e544c5ee4c6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:36 devstack sudo[107543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ff483115-5a56-446a-90de-e544c5ee4c6c
Sep 29 12:45:36 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:36 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d" returned: 0 in 0.404s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:36 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d
Sep 29 12:45:36 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:36 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ff483115-5a56-446a-90de-e544c5ee4c6c" returned: 0 in 0.247s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961aed49-bdb4-4006-854a-3068917d457b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff483115-5a56-446a-90de-e544c5ee4c6c', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b52b08-6d97-493e-84ac-9c95eb4b7590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:36 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Volume volume-ff483115-5a56-446a-90de-e544c5ee4c6c (ff483115-5a56-446a-90de-e544c5ee4c6c): created successfully
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b52b08-6d97-493e-84ac-9c95eb4b7590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Flow 'volume_create_manager' (e29249a6-8225-4186-adc4-6fc95a99026b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:45:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-c9b8385d-0a78-4a6f-8f49-231f941a0aa7 tempest-ProjectReaderTests-791209559 None] Created volume successfully.
Sep 29 12:45:36 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-3e80ad6e-1fc6-46ab-b723-d6f50e38766d" returned: 0 in 0.246s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-quobyte-3e80ad6e-1fc6-46ab-b723-d6f50e38766d" released by "delete_volume" :: held 0.722s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Created reservations ['47ef3026-802d-457e-9f4f-dde19e9544bb', 'f8583448-8cee-438d-bf6f-da281579e491', 'd5cea76a-4648-4e51-9746-203cb654e3d5', '60fe9abd-12e1-4030-96db-50da590ac77e'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:36 devstack sudo[107551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:45:36 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Acquiring lock "cinder-ff483115-5a56-446a-90de-e544c5ee4c6c-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Lock "cinder-ff483115-5a56-446a-90de-e544c5ee4c6c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Acquiring lock "cinder-quobyte-ff483115-5a56-446a-90de-e544c5ee4c6c" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Lock "cinder-quobyte-ff483115-5a56-446a-90de-e544c5ee4c6c" acquired by "delete_volume" :: waited 0.019s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf022cb-4bed-4e34-916f-a5c24a725001]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ff483115-5a56-446a-90de-e544c5ee4c6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:36 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ff483115-5a56-446a-90de-e544c5ee4c6c
Sep 29 12:45:36 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:36 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "cinder-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.287s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:45:36 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Deleted volume successfully.
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-bfbfba5e-a5d7-462c-9d65-e7cb6ba79cb0 tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-3e80ad6e-1fc6-46ab-b723-d6f50e38766d-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "cinder-quobyte-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-quobyte-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" acquired by "delete_volume" :: waited 0.014s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3903fc-aee0-4455-ae22-412e0db7407e]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:45:36 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:37 devstack sudo[107556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba
Sep 29 12:45:37 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:37 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ff483115-5a56-446a-90de-e544c5ee4c6c" returned: 0 in 0.416s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ff483115-5a56-446a-90de-e544c5ee4c6c {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:37 devstack sudo[107561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ff483115-5a56-446a-90de-e544c5ee4c6c
Sep 29 12:45:37 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:37 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" returned: 0 in 0.382s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:37 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba
Sep 29 12:45:37 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:37 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-ff483115-5a56-446a-90de-e544c5ee4c6c" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Lock "cinder-quobyte-ff483115-5a56-446a-90de-e544c5ee4c6c" released by "delete_volume" :: held 0.725s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Created reservations ['5bac141a-da96-4fa4-8ecb-0a461f8f535e', '4ed1b78c-bd1e-4e72-b937-81ecccac4049', '50bf723e-8853-4b7c-b4a4-17f32ba753be', 'baf4b6d7-2e2a-432f-9678-dec564913cdc'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:37 devstack sudo[107569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:45:37 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:37 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-quobyte-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba" released by "delete_volume" :: held 0.699s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Created reservations ['6a8969e0-a4b3-41d4-af1c-9364a4e081ed', 'd1f23a12-2e70-4ff4-9662-7fcd4480dd4f', 'f663d021-c00c-455d-9cd3-c47b00b0cdc7', 'af741295-d8c9-4add-8acc-e1f38c54aa70'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:37 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.265s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:45:37 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Deleted volume successfully.
Sep 29 12:45:37 devstack sudo[107573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:45:37 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:37 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-98a4f4cf-720d-4900-ad54-6753870eb8c6 tempest-ProjectReaderTests-791209559 None] Lock "cinder-ff483115-5a56-446a-90de-e544c5ee4c6c-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:37 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.289s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:45:38 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Deleted volume successfully.
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-fde91edd-239d-47db-acd1-f85d43a2805c tempest-SnapshotDependencyTests-1332276379 None] Lock "cinder-03f6dd68-9fd3-4009-8cb7-32371eb8c3ba-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.flows.manager.create_volume [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Flow 'volume_create_manager' (2e20ce4a-1bc2-4cc7-8e61-691d597e0002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c931caa-bfa1-4f7a-bb37-d4e43f512a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c931caa-bfa1-4f7a-bb37-d4e43f512a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-956595077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15c26e0-a496-41e6-9252-6b3de23490b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af12f0384bc24e74869c98c7bd85e092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:38Z,use_quota=True,user_id='21f9ea082d7a4fa590a95d7bf57b6795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97f455f-7d42-40a8-9ff1-ec53649c0f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97f455f-7d42-40a8-9ff1-ec53649c0f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb24aa3d-156a-423e-bba0-fa6c8017de40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb24aa3d-156a-423e-bba0-fa6c8017de40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15c26e0-a496-41e6-9252-6b3de23490b2', 'volume_name': 'volume-a15c26e0-a496-41e6-9252-6b3de23490b2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e971afb0-9975-41a4-8835-d1f6743d3de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e971afb0-9975-41a4-8835-d1f6743d3de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57632f5-3341-4bbd-9ce1-01e90b944517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:38 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Volume a15c26e0-a496-41e6-9252-6b3de23490b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15c26e0-a496-41e6-9252-6b3de23490b2', 'volume_size': 1}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b702692d430>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T10:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-956595077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15c26e0-a496-41e6-9252-6b3de23490b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af12f0384bc24e74869c98c7bd85e092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T10:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T10:45:38Z,use_quota=True,user_id='21f9ea082d7a4fa590a95d7bf57b6795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59f1a0f7-d9c6-4513-8bab-dbb9f54601f8),volume_type_id=59f1a0f7-d9c6-4513-8bab-dbb9f54601f8)}" {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.remotefs [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Creating volume a15c26e0-a496-41e6-9252-6b3de23490b2 {{(pid=86369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Selected osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4 as target Quobyte volume. {{(pid=86369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 12:45:38 devstack cinder-volume[86369]: INFO cinder.volume.drivers.remotefs [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] casted to osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a15c26e0-a496-41e6-9252-6b3de23490b2 1073741824 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:38 devstack sudo[107576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a15c26e0-a496-41e6-9252-6b3de23490b2 1073741824
Sep 29 12:45:38 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:38 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a15c26e0-a496-41e6-9252-6b3de23490b2 1073741824" returned: 0 in 0.506s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:38 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a15c26e0-a496-41e6-9252-6b3de23490b2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:38 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a15c26e0-a496-41e6-9252-6b3de23490b2
Sep 29 12:45:38 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:39 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a15c26e0-a496-41e6-9252-6b3de23490b2" returned: 0 in 0.289s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:39 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'} {{(pid=86369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 12:45:39 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57632f5-3341-4bbd-9ce1-01e90b944517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15c26e0-a496-41e6-9252-6b3de23490b2', 'volume_size': 1}' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97421573-9aef-49e6-8023-4531a43fbfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 12:45:39 devstack cinder-volume[86369]: INFO cinder.volume.flows.manager.create_volume [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Volume volume-a15c26e0-a496-41e6-9252-6b3de23490b2 (a15c26e0-a496-41e6-9252-6b3de23490b2): created successfully
Sep 29 12:45:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97421573-9aef-49e6-8023-4531a43fbfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 12:45:39 devstack cinder-volume[86369]: DEBUG cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Flow 'volume_create_manager' (2e20ce4a-1bc2-4cc7-8e61-691d597e0002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 12:45:39 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-9270524f-1618-4894-b12a-7a62ed3a583f tempest-ProjectReaderTests-791209559 None] Created volume successfully.
Sep 29 12:45:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Acquiring lock "cinder-a15c26e0-a496-41e6-9252-6b3de23490b2-delete_volume" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Lock "cinder-a15c26e0-a496-41e6-9252-6b3de23490b2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Acquiring lock "cinder-quobyte-a15c26e0-a496-41e6-9252-6b3de23490b2" by "delete_volume" {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 12:45:40 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Lock "cinder-quobyte-a15c26e0-a496-41e6-9252-6b3de23490b2" acquired by "delete_volume" :: waited 0.016s {{(pid=86369) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 12:45:40 devstack cinder-volume[86369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee31dc8-b033-47ce-a29e-3d1890c6ed58]: (4, 'qcow2') {{(pid=87610) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 12:45:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a15c26e0-a496-41e6-9252-6b3de23490b2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:40 devstack sudo[107587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a15c26e0-a496-41e6-9252-6b3de23490b2
Sep 29 12:45:40 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:40 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a15c26e0-a496-41e6-9252-6b3de23490b2" returned: 0 in 0.397s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:40 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a15c26e0-a496-41e6-9252-6b3de23490b2 {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:40 devstack sudo[107592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a15c26e0-a496-41e6-9252-6b3de23490b2
Sep 29 12:45:40 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:41 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef/volume-a15c26e0-a496-41e6-9252-6b3de23490b2" returned: 0 in 0.264s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Lock "cinder-quobyte-a15c26e0-a496-41e6-9252-6b3de23490b2" released by "delete_volume" :: held 0.699s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:41 devstack cinder-volume[86369]: DEBUG cinder.quota [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Created reservations ['f34be502-ea50-4db6-bf30-2b5cb73ee94e', '525cab4f-99d6-4cbb-ac82-f3e5ad739116', 'de972e73-aa21-425f-9745-596af4900462', '5e37aa54-b78a-4200-9bd8-0eeb72292f6a'] {{(pid=86369) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 12:45:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 12:45:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 12:45:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4': None} {{(pid=86369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 12:45:41 devstack cinder-volume[86369]: DEBUG cinder.volume.drivers.quobyte [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31bab5f4-e2eb-478e-9439-5364f4963ed4'] {{(pid=86369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 12:45:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.lockutils [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 12:45:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 12:45:41 devstack sudo[107595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef
Sep 29 12:45:41 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 12:45:41 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root
Sep 29 12:45:41 devstack cinder-volume[86369]: DEBUG oslo_concurrency.processutils [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dc1c2d7cac086a1526e9351232bacef" returned: 0 in 0.289s {{(pid=86369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 12:45:41 devstack cinder-volume[86369]: DEBUG cinder.manager [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Notifying Schedulers of capabilities ... {{(pid=86369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 12:45:41 devstack cinder-volume[86369]: INFO cinder.volume.manager [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Deleted volume successfully.
Sep 29 12:45:41 devstack cinder-volume[86369]: DEBUG cinder.coordination [None req-93ae0738-ec5e-4ce0-967c-009517a5409a tempest-ProjectReaderTests-791209559 None] Lock "cinder-a15c26e0-a496-41e6-9252-6b3de23490b2-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86369) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 12:45:51 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:SELECT=49,cinder:UPDATE=81,cinder:INSERT=17,cinder:DELETE=8 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 12:45:51 devstack cinder-volume[86369]: DEBUG dbcounter [-] [86369] Writing DB stats cinder:UPDATE=65,cinder:INSERT=18,cinder:DELETE=5,cinder:SELECT=56 {{(pid=86369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}